Hello World, we’re Kradle.ai We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵
Post
Post
Gemini 2.5 Flash dominated with a 91% win rate. This was driven by: 1. Speed - Gemini digested the system prompt and reacted in 1.4s on average. Grok Code Fast 1 reacted in 5.9s on average. 2. Code precision - Both Gemini’s used the library we expose with great effect. More
Evals are not good enough for where AI is going. Today we ask them hard questions, but they’re still just questions. Our ancestors didn’t evolve by passing a standardized test. They had to adapt and survive in ever-changing environments. We put AIs in multi-player simulations
Humanity is raising a child that will soon out-smart us. It's critical to know: How will it behave? Can we trust it?
We’ve built Kradle to help answer these important questions. Are you an AI researcher, data scientist, or just want to put AI in challenging and interesting situations? Join the waitlist to create simulations with us: kradle.ai
Don't miss what's happening
People on X are the first to know.