Settings

Theme

Checkout this coding harness that compiles codebase. 78% SWE-Bench (DS v4flash)

benzi.fly.dev

3 points by sessionking · 4 comments

Reader

3 threads
sessionkingOP

redid the about page: https://benzi.fly.dev/about. Contains actual information now instead of a "self-aware" angle it previously had (Benzi read its own score code and made that page).

showhz

original show HN post here: https://news.ycombinator.com/item?id=49226627

sessionkingOP

Benzi is a code intelligence software.

It starts with a tree sitter, and produces a unique Benzi ID for all symbols in arbitrarily large codebases.

With all callflow and dataflow resolved, the agent simply queries the codebase instead of reading though it using traditional RAG approaches or trying to "rank" results using embedding-space approaches.

Benzi has several bonus features such as syntax+semantic verified model code edits, runtime tracer to track actual execution through the Benzi compiler, context aware model generated repros to fast track testing, etc.

On the benchmarks side, Benzi + DeepSeek V4 Flash scores 78% on SWE-bench Verified (benchmark details on the benchmark page). For comparison, DeepSeek reports 73.7% as the baseline scaffolding number for v4flash and self reports their own score to be 78.6%. HOWEVER. Benzi gets to this parity reading 3x less source code than the deepseek harness. (benchmarks page again)

Please try it out, and let me know what you think!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection