Cross-lingual Calibration of Pre-Generation Success Probes for Multilingual LLM Routing

Excerpt

arXiv:2610.06216v1 Announce Type: cross Abstract: Pre-generation success probes estimate response correctness from a language model's hidden activations before decoding, enabling cost-aware routing. While prior work has demonstrated their utility primarily on English inputs, we study their reliability across languages along three dimensions: (1) whether they preserve the ranking of likely successes and failures (DISCRIMINATION); (2) whether they retain probabilities that match observed success f