CentriQ: Calibration-Free Quantization of Diffusion Transformers via Exact Mean Centering

Excerpt

arXiv:2610.06260v1 Announce Type: cross Abstract: Diffusion transformers (DiTs) achieve state-of-the-art image generation, but their sampling cost limits deployment. Quantizing both weights and activations to 4 bits reduces this cost, yet existing methods fall short in one of two ways. Calibration-based methods are tied to a specific checkpoint and prompt distribution, whereas data-free Hadamard rotation, effective for LLMs, loses quality on DiTs. We show that this loss has a structural cause. A