Vibes vs. Evidence: What delivers AI code review quality
dsifry.github.io
1 thread
Evidence is how precise the findings are, and how often people act on them. More comments are not evidence.
Volume without action is just noise.
We tried multiple AI Code reviewers and LLM based review bots and they are all the same, a lot of volume with no real action after that.
Then decided to build Revix AI, where the main focus is basically to revert that. Prefer less comments but act on all of them even if we miss some things rather than get 20 comments that I will end up not reading and in the end get more issues into prod.