FreshBrew: A Benchmark for Evaluating AI Agents on Java Code Migration

Excerpt

arXiv:2510.04852v3 Announce Type: replace-cross Abstract: AI coding assistants are rapidly becoming integral to modern software development. A key challenge in this space is the continual need to migrate and modernize codebases in response to evolving software ecosystems. Traditionally, such migrations have relied on rule-based systems and human intervention. With the advent of powerful large language models (LLMs), AI-driven agentic frameworks offer a promising alternative-but their effectivene