We built an open-source, model-neutral agent harness and compared it with claude managed agents - for the same model, got same accuracy, upto 75% lower cost

Excerpt

We have been working on an open-source, model-neutral agent harness for general purpose agents called TrueForge, and wanted to understand how much the harness itself actually matters. So we ran 14 tasks from DevRev Enterprise-Bench through multiple harness/model combinations, three times each with a blind judge. The result that surprised us most: Claude Managed Agents + Opus 4.8: 11/14 tasks solved | $11.8/run | 10.0M tokens/run TrueForge + Opus 4.8: 11/14 tasks solved | $8.6/run | 3.7M tokens/r