bisonbear

Karma: 52
Created: 10 months ago

About

Building evals for AI coding agents, on your repo. Tests pass. Nobody's measuring the rest. http://stet.sh email ben@stet.sh

Recent Submissions

1. ▲ I compared 5 popular token saving methods in Codex and found that none delivered (stet.sh) 2 points · 10 days ago · 0 comments
2. ▲ I ran Sonnet 5 vs. Opus 4.8 head to head on 24 tasks to see what's different (stet.sh) 1 point · 24 days ago · 0 comments
3. ▲ I evaluated GLM 5.2 against the frontier on tasks from real repos (stet.sh) 2 points · 1 month ago · 2 comments
4. ▲ I benchmarked Opus 4.8 vs. GPT 5.5 on 2 open source repos (stet.sh) 3 points · 2 months ago · 0 comments
5. ▲ I used autoresearch to improve my AGENTS.md, measured against real tasks (stet.sh) 8 points · 2 months ago · 7 comments
6. ▲ A brief investigation into the GPT-5.5 regression claims (stet.sh) 1 point · 2 months ago · 0 comments
7. ▲ The Opus 4.7 reasoning curve - Medium is the best default? (stet.sh) 1 point · 2 months ago · 0 comments

All submissions on HN · View profile on HN