OpenAI disbands its robotics team as its general models start running robots
fortune.comThe Bitter Lesson comes for everything.
This looks like general cost cutting to boost some numbers before IPO.
They didn't fire or lay them off, they just disbanded the team and moved the researchers to other teams, so how is it cutting costs?
More wood behind fewer arrows
Is there a primer on how to actually use LLMs to control robots? Seems very token inefficient if you have to stream commands at 60fps.
The LLM's are basically used for the big picture. What is the situation. What is the goal and how to achieve it. Not direct control of all the servos.
Robotics are generally layered systems with lower latency/realtime systems running literally on the servos and other embedded hardware that use servo feedback and direct sensor access to operate, then building up complexity with tiers of increasing policy, usually all capable of working without the higher order layers which can inject desired states into lower order rings.
The nvidia study explains it https://research.nvidia.com/labs/srl/projects/astranomy/
I think the idea is to just have the LLMs write the control systems and RL on that
Depends on what your goals are. If your goal is to give investors erections, then re-using your existing trillion dollar model is efficient.
they have decision models now