Robot learns whole-arm control to lift large objects accurately

CALM: Current Aligned Link Manipulation for Single Arm Oversized Object Lifting

Robotics

Summary

Robots usually pick up objects using just their hands, but humans use their whole arm to handle big things more easily. This paper presents a way to teach a robot arm to use its joints and motors together to move and lift oversized objects. The authors trained multiple robot actions in simulation, teaching the arm to reposition, grasp, and lift while closely simulating motor feedback for more realistic control. Their method works well both in computer tests and in the real world, successfully lifting large objects most of the time.

What this means in practice

Authors

Jun Hu, Sihan Chen, Kosta Jovanovic, David Navarro-Alarcon, Xueqian Wang, Jia Pan, Peng Zhou

Abstract

Most robots manipulate objects solely with their end effectors, whereas humans flexibly leverage different body parts, such as the forearm and elbow, especially when handling oversized objects. Learning such whole-arm manipulation is chal-lenging due to long-horizon sparse rewards, limited contact sens-ing, and the sim-to-real gap in contact and actuator dynamics. To address these challenges, we propose Current-Aligned Link Manipulation, a framework for learning long-horizon contact-rich manipulation using motor current as joint load related feedback. Three stage-specific policies first learn repositioning, grasping, and lifting using privileged simulation information, and a stage router sequences them to generate complete task demonstrations. For sim-to-real transfer, a causal current mapper predicts physical motor current from simulated joint histories, aligning the actuator current observation between simulation and hardware. A unified student policy then learns from these demonstrations using only deployable sensor observations and is further refined with DAgger. The task policies are trained entirely in simulation, and the final student is deployed on hardware. Experiments demonstrate 76.2% (762/1000 trials) complete-task success in simulation and 73.3% success (22/30 trials) on the physical robot for sequential oversized-object lifting.