Clock Diffusion: Efficient Semi-Autoregressive Continuous Diffusion Language Models

Excerpt

arXiv:2610.00894v1 Announce Type: new Abstract: Recent works on continuous diffusion for discrete data have demonstrated performance on par with comparable discrete diffusion models. However, these continuous counterparts lack key features that are essential to practical use as language models, namely variable-length generation and support for a key-value cache, and they still lag behind the frontier of autoregressive and discrete diffusion quality. In this work, we address these limitations. We