MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Excerpt

We introduce MLE-bench, a benchmark for measuring how well AI agents perform at machine learning engineering.