You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue

Excerpt

arXiv:2610.06496v1 Announce Type: new Abstract: When a large language model handles a multi-turn task and a user proposes a change but ultimately rejects it, the model should continue as if nothing changed. We find a surprising failure: merely mentioning a rejected change can derail task execution, even when the user's final intent remains unchanged. To systematically study language model behavior under evolving user intent, we introduce Intent-Eval, a controlled benchmark spanning tool actions,