Teleoperation
A human remotely controlling a robot in real time, often used to collect demonstration data
As defined in World's Top Researcher on AI, LLMs, and Robot Intelligence
Other definitions
Remote human operation or monitoring of a vehicle/robot, where people are in the loop from a control center.
Andrej Karpathy — AGI is still a decade away
Where it comes up · 5
- World's Top Researcher on AI, LLMs, and Robot Intelligence6 claims
- Andrej Karpathy — AGI is still a decade away1 claim
- Fully autonomous robots are much closer than you think – Sergey Levine1 claim
- Dwarkesh Patel Podcast - The data black hole at the center of AI1 claim
- Eric Vishria - A Decade of Lessons Investing in Software & Hardware - [Invest Like the Best, EP.486]1 claim
Most important claims · 10 of 10Search all claims for “Teleoperation” →
- Once a robot reaches a sufficient competence level, it can learn not only from low-level teleoperated actions but also from being instructed through language, so a person standing by and telling it the next steps in words already provides information the robot uses to improve.Fully autonomous robots are much closer than you think – Sergey Levine
- Self-driving is nowhere near done: deployments are minimal and uneconomical, the cars rely on elaborate teleoperation centers with more human-in-the-loop than people realize, so rather than removing the human we have moved them somewhere out of sight.Andrej Karpathy — AGI is still a decade away
- A person can learn to teleoperate any humanoid or robot arm within hours, and robotics has not become a multi-trillion dollar industry because AIs learn far less efficiently than humans, so even millions of hours of demonstrations are insufficient for complex open-ended tasks.Dwarkesh Patel Podcast - The data black hole at the center of AI
- The under-asked question is how someone should start using autonomous robots for a task, including whether to set up teleoperation, modify the task, or design new hardware, and people often assume that any easily collected data (such as videos of humans) is the right data, which is often wrong and domain-dependent.World's Top Researcher on AI, LLMs, and Robot Intelligence
- Robots can exceed human speed on tasks like plugging in cables: humans pause to process what they are doing, and teleoperation is even slower; removing those pauses, and speeding up with demonstration-based success criteria and RL, makes robots much faster, and the bottleneck is processing speed, which computer science understands well.World's Top Researcher on AI, LLMs, and Robot Intelligence
- A key uncertainty that changes how companies should prepare is whether robots will rely mainly on teleoperated demonstrations or on reinforcement learning from autonomous experience; a 90/10 mix in one direction versus 10/90 in the other would require dramatically different data strategies, and the answer will emerge over the next few years.World's Top Researcher on AI, LLMs, and Robot Intelligence
- The timeline for useful robots is highly uncertain because the field faces a bootstrap problem: robots must cross an activation-energy threshold of usefulness to be deployed and collect open-world data at scale, and the timing depends on whether data comes from teleoperation, autonomy, shared autonomy, or coaching.World's Top Researcher on AI, LLMs, and Robot Intelligence
- Robotics lacks an internet-scale corpus of data to bootstrap models, so the workable path is to first collect high-value data, pre-train a base model on it, and then use small post-training examples with RL to teach new tasks, mirroring the LLM pipeline.Eric Vishria - A Decade of Lessons Investing in Software & Hardware - [Invest Like the Best, EP.486]
- In the long run, general learned robot systems could enable very small and very large machines in medicine and surgery, and could remove the need for robots to resemble humans or even be human-controlled, since current robotic surgery is done entirely through teleoperation.World's Top Researcher on AI, LLMs, and Robot Intelligence
- Whether a robot should be deployed under human teleoperation or as a partially autonomous system is domain-dependent; some settings may accept offsite human control, while people may not want a home robot constantly controlled by a remote person.World's Top Researcher on AI, LLMs, and Robot Intelligence