ReLope: From Hidden-State Probing to a Decision Module for Multimodal LLM Routing

Excerpt

arXiv:2603.24787v3 Announce Type: replace Abstract: Routing balances performance and cost in hybrid systems by escalating selected queries from a lightweight model to a powerful but expensive one. Hidden-state probes provide an effective routing signal by predicting the small model's correctness from hidden states it already computes. Although effective in text-only settings, their behavior on multimodal LLMs (MLLMs) is less understood. We find that correctness is harder to predict from hidden s