If It's Not Buggy, Don't Fix It: On the Dynamics of Iterative Bug-fixing with LLMs

Excerpt

arXiv:2609.10123v1 Announce Type: cross Abstract: Large language models (LLMs) have become ubiquitous in software development, with LLM-based automated program repair tools increasingly used during code review. In this report, we explore the iterative blind use of LLMs as bug-fixers. Across multiple models and repair environments, we find that LLMs consistently claim to detect bugs in entirely bug-free programs while the rate of repair of buggy programs is less than that of the damage to correct