Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering
arxiv.org
1 thread
Couldn't agree more. Coding benchmarks are just a score. Benchmark the harness.
Couldn't agree more. Coding benchmarks are just a score. Benchmark the harness.