Humanoid robots smoothly connect motions using human movement patterns

Robot Motion Transition with Human Motion Prior

Robotics

Summary

Making humanoid robots perform many different moves in a row is hard because simply joining the end of one move to the start of the next can look awkward or wrong. The authors developed STAMP, which uses knowledge learned from human motions to find the best way to align and blend these moves smoothly. By translating robot motions to a shared human motion format, they decide how to position, angle, and time transitions before turning them back into robot actions. They tested this on real robots and showed it helps create long, continuous motion sequences.

What this means in practice

  • For robotics engineers: Create smooth, continuous sequences of varied motions for humanoid robots using human motion data to guide transitions.
  • For robot software developers: Train motion-tracking policies for robots by generating realistic motion transitions based on human movement priors and alignment models.

Authors

Taehyun Byun, Taemoon Jeong, Yoonbyung Chai, Woojin Wie, Insu Park, Kyungjae Lee, Sungjoon Choi

Abstract

Humanoid motion-tracking policies can reproduce diverse behaviors, yet connecting independently acquired motions into a continuous sequence remains challenging. Interpolation connects boundary poses without considering whether their relative position, heading, and timing provide suitable conditions for a transition. A generative motion prior can produce richer motion, but poorly arranged boundaries may cause it to generate excessive locomotion, turning, or another unintended action. We present Spatio-Temporal Alignment with a Motion Prior (STAMP), a framework for connecting independently acquired humanoid motions through a Robot-to-Human-to-Robot process. STAMP uses human motion space to draw on rich motion priors and reuse transition knowledge across robot embodiments. Its key component is a learned alignment model that determines the boundary conditions for motion inbetweening. Given the two motions retargeted to a human rig, the alignment model ranks candidate positions, headings, and transition durations for the following motion. A human motion prior generates the transition under the selected alignment. The completed sequence is retargeted to the robot and used as a reference to train a motion-tracking policy. We evaluate the tracking success of the generated transitions on Unitree~G1 and~ROBOTIS K1. Physical robot demonstrations further show that STAMP connects independently acquired motions into long-horizon sequences. Project page: https://childtoy.github.io/STAMP-project