Questioning the Questions: Sustaining Self-Evolution in Reasoning Models

Excerpt

arXiv:2610.04299v1 Announce Type: cross Abstract: Self-evolving reasoning models learn from their own generated questions, yet repeated self-training can lead to performance collapse. In this paper, we investigate why performance deteriorates over successive rounds and how to sustain self-evolution. Our analysis identifies two recurring quality problems in self-generated questions: invalid questions and repeated variants of the same mathematical questions. First, invalid questions become more pr