@TEDchris @vkhosla Yes, I do. LLMs produce their answers with a fixed amount of computation per token. There is no way for them to devote more (potentially unlimited) time and effort to solving difficult problems. This is very much akin to the human fast and subconscious "System 1" decision

2 min read Original article ↗

Yes, I do. LLMs produce their answers with a fixed amount of computation per token. There is no way for them to devote more (potentially unlimited) time and effort to solving difficult problems. This is very much akin to the human fast and subconscious "System 1" decision process. True reasoning and planning would allow the system to search for a solution, using a potentially unlimited unlimited time for it. This iterative inference process is more akin to the human deliberate and conscious "System 2". This is what allows humans and many animals to find new solutions to new problems in new situations. Some AI systems have planning abilities, namely those that play games or control robots. Game playing AI systems such as AlphaGo, AlphaZero, Libratus (poker), and Cicero (Diplomacy) have planning abilities. These systems are still fairly limited in their planning abilities, compared to animals and humans. To have more general planning abilities, an AI system would need to possess a *world model*, i.e. a subsystem that can predict the consequences of an action sequence: given the state of the world at time t, and an imagined action I could take, what would be the set of plausible states of the world at time t+1. With a world model, a system can plan a sequence of action so as to fulfill an objective. How to build and train such world models is still a largely unsolved problem. Even more complex is how to decompose a complex objective into a sequence of sub-objectives. This would enable hierarchical planning, something that humans and many animals can do effortlessly but is still completely out of reach of AI systems.