bisonbear
- Karma
- 65
- Created
- 1 year ago
About
Building evals for AI coding agents, on your repo. http://stet.sh email ben@stet.shRecent Submissions
- 1. ▲ How I run my agent fleet to build my product (stet.sh)
- 2. ▲ Measuring "cost per successful PR" chose Luna 6 low as the best model (stet.sh)
- 3. ▲ How I made a benchmark mined from my own repo that agreed with FrontierCode (stet.sh)
- 4. ▲ I ran Sol 6 vs. 6.1 on tasks from my own repo. It's cheaper and at least as good (stet.sh)
- 5. ▲ I compared Opus 4.8 vs. Opus 5 on 25 of my tasks to see what the difference was (stet.sh)
- 6. ▲ I compared 5 popular token saving methods in Codex and found that none delivered (stet.sh)
- 7. ▲ I ran Sonnet 5 vs. Opus 4.8 head to head on 24 tasks to see what's different (stet.sh)
- 8. ▲ I evaluated GLM 5.2 against the frontier on tasks from real repos (stet.sh)