Is current AI architecture broken? Jagged intelligence suggests it may be

"There's something still not quite right with the current technology. I think the phrase that's becoming popular is 'jagged intelligence'. The fact that you can ask an LLM something and they can solve literally a PhD level problem, and then in the next sentence they can say something so clearly, obviously wrong that it's jarring. And I think this is probably a reflection of something fundamentally wrong with the current architectures, as amazing as they are."

Llion Jones, co-inventor of transformers architecture and now co-founder of https://sakana.ai/ researching alternatives.