Terrence Tao: AI Is Teaching Us Something Uncomfortable About Our Own Minds [video]
youtube.comGoing off on a tangent here: for over a decade, ever since I got an inkling of the power of neural networks, I've argued that privacy is the key to maintaining a broad diffusion of wealth in the modern electronically networked world.
What distinguishes human intelligence from LLM intelligence is largely information that the latter hasn't mopped up. So the information that the former is uniquely privy to is what gives it economic value.
I despise the "next token predictor" framing.
In order to predict the next token in this line "The solution to your problem is..." the entity needs to be able to solve your problem. Which is well beyond what people think of when they think of a token predicting statistical sequence.
The statistical sequence description is ridiculously incomplete.
the entity needs to be able to solve your problem.
People have fixed software bugs with zero knowledge of what the code is doing and no knowledge of the programming language at hand, purely by statistical pattern matching. Solving the problem with no understanding of it beyond the idea that whatever it was, the right answer was probably something that kind of matched the kind of patterns found in things they'd seen before.
So what does it mean, "to be able to solve your problem"?
> People have fixed software bugs with zero knowledge of what the code is doing and no knowledge of the programming language at hand, purely by statistical pattern matching.
Is that even true? Beyond an extremely simple example?
Yeah... I think you just made that up.
Next token predictor is as useful as saying that humans are just atoms and neurones.
It is technically true but meaningless.
An LLM agent is literally Turing complete. There is nothing it cannot compute.
Anytime you hear someone saying "it can't do this, or that..." they are factually incorrect.
The denial around these issues is beyond creepy: AI has clearly hit some tender nerve in the human mind.
Source? Turing completeness is a very specific mathematical definition, it would surprise me if a neural network met it. Real-world computers are only Turing complete if you assume that they have unlimited memory space -- which is a reasonable approximation, but technically not true.
Yes.
If we allow a file with unbounded storage (like your exception for physical computers) then an agent can easily perform the necessary state transitions and tape reads/writes.