Millimeter wave sensing limits human pose accuracy for robots
What Limits mmWave Human-State Sensing for Robot Perception?
RoboticsHuman-Computer Interaction
Summary
When robots need to track human body positions in bad conditions like smoke or darkness, millimeter-wave radar can see through obstacles and protect privacy better than cameras. But small radar setups create position errors big enough to affect robot safety and tracking. The authors studied what causes these errors and how techniques like using multiple viewpoints or better calculations help. They found these methods help reduce errors somewhat, but there are fundamental limits based on the radar design and environment. Their work helps robot builders decide whether to improve the radar hardware or the data processing software for better human sensing.
What this means in practice
- •For assistive robot developers: Design robot sensor systems that balance radar hardware limits with estimation methods for safer human tracking in challenging environments like smoke or darkness.
- •For search and rescue teams: Deploy robots with improved millimeter-wave sensing that reliably detects humans despite visibility issues, aiding in locating people in disaster zones.
Authors
Shuntian Zheng, Guangming Wang, Hongyang He, Shuai He, Yu Guan
Abstract
Assistive robots and search-and-rescue platforms require reliable human state sensing in smoke, darkness, and privacy-sensitive environments, where cameras and LiDAR may be unreliable Millimeter-wave radar offers an alternative that works without ambient light, penetrates smoke, and does not capture visual appearance. However, the compact arrays that fit robot size, power, and cost budgets have limited apertures, producing joint-localization errors on the order of decimeters at a few meters, large enough to compromise the safety margins and tracking accuracy a robot depends on. Existing pipelines reduce pose error through frame fusion, multiple viewpoints, return selection, or stronger estimators, but examine one technique at a time, without relating its effect to a shared measurement limit or separating gains from added information from gains from estimator completion. We address this gap with a framework that models the human and environment as one time-varying scattering field and states a Cramer-Rao type error floor for joint localization as a function of bandwidth, aperture, signal-to-noise ratio, fused frame count, phase coherence, and visibility of retained returns. We then use existing frame fusion, multi viewpoint, return selection, and pose estimation methods as matched probes of this floor rather than as competing pipelines. Under the evaluated conditions, experiments on three datasets and a live deployment show these strategies move joint localization error in the predicted directions, for example lowering mean per-joint position error from about 97 to 65 mm with a second viewpoint, while a stronger estimator mainly lowers overall error by completing joints the measurement cannot resolve. These results give the robotics community a principled basis for deciding whether to prioritize observation design or estimator capacity when deploying reliable mmWave human sensing.