LoopCD: Loop-wise Contrastive Decoding for Improving Reasoning in Looped Language Models

Excerpt

arXiv:2609.24196v1 Announce Type: new Abstract: Looped Language Models (LoopLMs) perform "latent reasoning" by recursively refining internal latent representations with shared weights, offering a more effective alternative to explicit verbal reasoning. Despite their effectiveness, we find that LoopLMs remain prone to loop instability: unstable refinement across iterations can produce localized uncertain "hard" tokens associated with reasoning errors. To address this, we propose LoopCD, loop-wise