Teleoperation
- In French:
- Téléopération
Definition
Control of a robot at a distance by a human operator, live, using a dedicated interface. It is also used to collect demonstrations: the operator’s movements, recorded together with what the robot perceives, feed imitation learning. On Vuntum’s autonomy scale, a robot controlled this way is rated A0.
Checked on against the references below. · Written with AI · checked against the sources Source: IEEE Robotics and Automation Society, technical committee “Telerobotics”.
Concrete examples
For its robots, including the Vega 1 Pro, Dexmate describes an operator driving the robot in VR or with an open-source exoskeleton kit, in the space where the skill will run; each session is recorded as training data for imitation learning. Sensori, maker of Yuri, sums up its approach: “We teleoperate until we reach 100% automation.”
What it changes for you
In LeRobot, Hugging Face’s robotics library, demonstrations are collected with a teleoperation device, such as a leader arm or a keyboard. Its documentation suggests at least 50 episodes, with 10 per location, for a first task of grasping an object at several locations and placing it in a bin, and a trained policy expects the same camera names and resolution at deployment as at recording time.
Not to be confused with
Replay is not teleoperation: the robot then redoes the movements of an episode that was already recorded, whereas in teleoperation an operator drives it live. The LeRobot documentation presents replay as a way to test the repeatability of the robot’s actions.
Additional material checked on .
Related terms
References
- IEEE Robotics and Automation Society, technical committee “Telerobotics”
- Zhao et al., “Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware”, 2023 (arXiv:2304.13705)
- Dexmate, shop and FAQ (VR or exoskeleton teleoperation)
- Sensori Robotics, home page (“Teleoperated and simulation” section, Yuri)
- Hugging Face, LeRobot: Imitation Learning on Real-World Robots