Settings

Theme

Show HN: Verification of Human Understanding of LLM-Generated Work

github.com

1 points by jbethune 7 days ago · 3 comments · 1 min read

Reader

Built this back in March because of fears my vibe coding was getting away from me. Basically it just analyzes PRs and asks a question to the developer about them to verify understanding. Turned into a larger project with my consulting firm and clients over the last month. Going to leave the original basic implementation open source.

missmoss 7 days ago

Curious if there's a demo/screenshot on what questions developers should expect and what acceptable answers look like. Checked out the repo but didn't find the showcase.

  • jbethuneOP 7 days ago

    The SaaS version has a short video demonstrating the UX: https://ninchi.ai

    • missmoss 6 days ago

      Cool! I watched the demo. The concept makes sense. Quick thought: free-text answers might be high friction for adoption. Not sure if you'd consider various verification method, but something like multiple choice questions or "highlight the relevant code chunk" could be lower effort for the developer, and easier to evaluate programmatically too.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection