MoLE: Mixture of Latent Experts for Complementary Visual Reasoning

Excerpt

arXiv:2610.01917v1 Announce Type: cross Abstract: Latent visual reasoning equips vision--language models with continuous intermediate states that can process visual evidence without explicit textual reasoning traces or repeated image operations. However, existing methods often allow multiple latent tokens to access the same visual evidence through shared value projections, providing no mechanism for them to extract complementary visual information; simply increasing the latent budget can therefo