Towards Miniature Humanoid Tele-Loco-Manipulation Using Virtual Reality and Reinforcement Learning

2026-07-22Robotics

RoboticsHuman-Computer InteractionMachine Learning
AI summary

The authors developed a new control system that lets small humanoid robots be operated remotely like larger, more expensive robots. Their system uses full-body control to help the robot walk and manipulate objects, demonstrated on a small robot called ROBOTIS OP3. They showed the robot could walk while moving its arms and move cubes within a short time using expert teleoperation. This work suggests that more accessible miniature humanoid robots can perform tasks remotely using advanced control methods.

humanoid robotsteleoperationtelepresenceminiature robotslocomotion controlreinforcement learningrobot manipulationROBOTIS OP3degrees of freedombiomimicry
Authors
Nicolas Kosanovic, Jordan Dowdy, Jean Chagas Vaz
Abstract
Full-sized humanoid robot capabilities have grown exponentially in recent years, aiming towards general-purpose deployment in human environments. A popular control method used by manufacturers utilizes Virtual Reality for upper-body teleoperation and Reinforcement Learning for lower-body balance and locomotion control. As a result, a single remote operator can see, manipulate, and navigate about a real, distant physical environment. This powerful control stack is often relegated to expensive full-sized robots, many of which are inaccessible to the research community. Miniature humanoids are more prevalent, but employ less biomimicry in their design (e.g. fewer sensors, Degrees of Freedom, etc) and lack similar developments. This paper describes a compliant full-body telepresence control stack developed from the ground up for miniature humanoids. Framework experimentation on ROBOTIS OP3 hardware showcases walking at speeds up to 0.45 m/s independent of arm motions. Tele-loco-manipulation is demonstrated via a cube relocation experiment with an expert human operator. On average, the teleoperated system moved 2 different 40 g cubes within 10 mins, walking a total distance of 5 m. Overall, the developed system shows potential for miniature humanoid tele-loco-manipulation.