Show HN: Gemini models are getting better – we can prove it
github.comWe ran seven Google models through the same task, in the same multi-agent harness.
Improvements to reasoning and tool calls are the main reasons for the improvements. We saw less and less reasoning and some of the lowest invalid tool calls across the entire evaluation suite.
Github link for the run output and analysis. More at evals.favur.dev
No comments yet.