EPIC: Efficient and Parallel Inference under CFG Constraints for Diffusion Language Models

Excerpt

arXiv:2606.00722v2 Announce Type: replace-cross Abstract: Controlling language model outputs is essential for ensuring structural validity, reliability, and downstream usability, and diffusion language models are no exception. Recent advances in diffusion language model decoding have extended output control beyond regular constraints to context-free grammar (CFG) constraints. However, the prior CFG-constrained decoder can be up to four times slower than unconstrained decoding, forcing a trade-of