arXiv cs.LGOctober 2, 2026
Code Owns the Simulation, Jev Owns the Evaluation
Excerpt
arXiv:2610.01834v1 Announce Type: cross Abstract: Judgment models such as \jev{} return, in a single call and without reasoning text, a probability for each described option. This makes them attractive as an agent's action-selection layer, but it is unclear which decisions they can be trusted with. We test \jev{} on reflection tests, one-shot matrix games, the text game ALFWorld and robot control, and find a sharp boundary. \jev{} succeeds when the right option can be judged from what the input