GitHub - aavetis/PRarena: This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates regularly.

2 min read Original article ↗

PR Analytics: Volume vs Success Rate (auto-updated)

View the interactive dashboard for these statistics.

Understanding the Metrics

Different AI coding agents follow different workflows when creating pull requests:

  • All PRs: Every pull request created by an agent, including DRAFT PRs
  • Ready PRs: Non-draft pull requests that are ready for review and merging
  • Merged PRs: Pull requests that were successfully merged into the codebase

Key workflow differences: Some agents like Codex iterate privately and create ready PRs directly, resulting in very few drafts but high merge rates. Others like Copilot and Codegen create draft PRs first, encouraging public iteration before marking them ready for review.

The statistics below focus on Ready PRs only to fairly compare agents across different workflows, measuring each agent's ability to produce mergeable code regardless of whether they iterate publicly (with drafts) or privately.

Data sources

Explore the GitHub search queries used:


chart

Current Statistics

Project Ready PRs Merged PRs Success Rate
Copilot 1,491,570 1,432,975 96.07%
Codex 4,907,647 4,307,030 87.76%
Cursor 269,356 264,971 98.37%
Devin 155,854 94,602 60.7%
Codegen 6,590 4,118 62.49%
Jules 208,335 187,536 90.02%