Asking Earns Nothing: Scoring the Decision to Act in BFCL Multi-Turn

Excerpt

arXiv:2610.04429v1 Announce Type: new Abstract: An agent that lacks the information it needs should ask rather than act, and the task definitions of agent leaderboards say so. BFCL multi-turn builds two of its four categories around a turn on which the model is supposed to ask, and its scorer never looks at that turn: the gold trajectory there is empty, the checker skips it, and the scripted user cannot answer, so asking earns nothing, guessing costs nothing on that turn, and asking twice loses