AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling
Language remains an outlier in generative modeling: while images, video, and audio are increasingly modeled in continuous latent spaces, text generation still relies predominantly on discrete tokens. Existing continuous language models either inherit embedding spaces not designed for joint generation and decoding, or compress autoencoded latents to ease diffusion, sacrificing token-level fidelity. Instead of simplifying the representation to suit the generative model, we preserve a high-capacity, decodable text latent and design the diffusion model to learn its distribution directly. We introduce AURORA-LM, a continuous-latent diffusion language model that separates the construction of a ...
| Authors | Jiajun Liang, Yucheng Liao, Yukang Cao et al. |
|---|---|
| Primary category | cs.CL |
| Published | 3 August 2026 |
| Last updated at source | 3 August 2026 |
Connected in the knowledge graph
- fyv587/aurora-text-autoencoderModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.