Can LLMs accelerate science? An experiment

How do we square this with claims that Claude has a high IQ?

I would love to see this repeated for other LLMs, with the same data and prompts.