Papers for

assistive robot developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Millimeter wave sensing limits human pose accuracy for robots

What Limits mmWave Human-State Sensing for Robot Perception?

Abstract: Assistive robots and search-and-rescue platforms require reliable human state sensing in smoke, darkness, and privacy-sensitive environments, where cameras and LiDAR may be unreliable Millimeter-wave radar offers an alternative that works without ambient light, penetrates smoke, and does not capture visual appearance. However, the compact arrays that fit robot size, power, and cost budgets have limited apertures, producing joint-localization errors on the order of decimeters at a few meters, large enough to compromise the safety margins and tracking accuracy a robot depends on. Existing pipelines reduce pose error through frame fusion, multiple viewpoints, return selection, or stronger estimators, but examine one technique at a time, without relating its effect to a shared measurement limit or separating gains from added information from gains from estimator completion. We address this gap with a framework that models the human and environment as one time-varying scattering field and states a Cramer-Rao type error floor for joint localization as a function of bandwidth, aperture, signal-to-noise ratio, fused frame count, phase coherence, and visibility of retained returns. We then use existing frame fusion, multi viewpoint, return selection, and pose estimation methods as matched probes of this floor rather than as competing pipelines. Under the evaluated conditions, experiments on three datasets and a live deployment show these strategies move joint localization error in the predicted directions, for example lowering mean per-joint position error from about 97 to 65 mm with a second viewpoint, while a stronger estimator mainly lowers overall error by completing joints the measurement cannot resolve. These results give the robotics community a principled basis for deciding whether to prioritize observation design or estimator capacity when deploying reliable mmWave human sensing.

Fri 6 NovRoboticsHuman-Computer Interaction
The gist
When robots need to track human body positions in bad conditions like smoke or darkness, millimeter-wave radar can see through obstacles and protect privacy better than cameras. But small radar setups create position errors big enough to affect robot safety and tracking. The authors studied what causes these errors and how techniques like using multiple viewpoints or better calculations help. They found these methods help reduce errors somewhat, but there are fundamental limits based on the radar design and environment. Their work helps robot builders decide whether to improve the radar hardware or the data processing software for better human sensing.
Open → 2611.08863v1

Context aware explanations improve trust in robot navigation for the blind

Navigation Explainability for Object Avoidance with LLMs for Assistive Robots

Abstract: Blind and visually impaired individuals face uncertainty when navigating unfamiliar areas. Whether a cane or a guide dog is used for navigation, this may prove to be challenging. To mitigate this challenge, we present the Context-Aware Navigation Explanation framework that explains guide dog movements for obstacle avoidance and navigation using a large language model. This system integrates perceptual context with planned future trajectories to generate natural-language explanations of robot movement. We deploy the system on a Unitree Go2 platform in indoor navigation scenarios and evaluate how different explanation context configurations affect user trust and explanation satisfaction. Results show a strong positive relationship between explanation satisfaction and trust, and suggest that combining obstacle information with future trajectory leads to the most effective explanations. These findings highlight the potential of context-aware language explanations to improve transparency and trust in assistive robot navigation.

Tue 20 OctRobotics
The gist
Blind or visually impaired people often find it hard to understand why guide robots or dogs move in certain ways to avoid obstacles. The authors created a system that uses a large language model to explain these movements in simple sentences by combining what the robot sees with its planned path. They tested this on a robot indoors and found that explanations which include both obstacle details and future movement boosted users' trust and satisfaction the most. This shows that clear, context-rich language can make assistive robots easier to trust and use.
Open → 2610.28920v1

Mobile robot manipulation improved by seeing coordinating and imagining

MM-ABC: Towards Generalist Mobile Manipulation via Seeing, Coordinating and Imagining

Abstract: Mobile manipulation extends robot interaction beyond a fixed kinematic workspace by making the reachable region itself controllable. This flexibility introduces two central challenges: spatially grounded perception under continuous ego-motion and coordinated control of heterogeneous arm and base actions. Existing approaches strengthen geometry through explicit 3D representations or predictive world models, and often decouple mobility and manipulation into separate action streams. We argue that effective mobile manipulation requires not only decoupling, but also representations that support efficient cross-stream collaboration. We present MM-ABC, a foundation model built around Seeing, Coordinating, and Imagining Arm-Base Collaboration. MM-ABC combines sparse multi-level VLM features for spatial perception; a training-only future branch that uses world imagination and geometric intent as extra supervision, strengthening perception and manipulation-intent prediction and improving the overall learning signal; and MM-APT, which coordinates separate manipulation and mobility streams through masked joint attention and clean-action x-prediction. In controlled ablations, replacing clean-action prediction with velocity prediction lowers success on RoboCasa365 composite-seen tasks from 32.8% to 29.2%, and removing future supervision or multilevel conditioning causes larger drops. We pretrain MM-ABC on 5,000+ hours of heterogeneous robot data spanning 400K+ episodes, 12 datasets, and 17 embodiments. Experiments cover EBench, RoboCasa365, ManiSkill-HAB, LIBERO, LIBERO-Plus, and real-world mobile manipulation. MM-ABC achieves 44.71% success on EBench, 61.2% on RoboCasa365, 99.1% on LIBERO, 82.8% on LIBERO-Plus without perturbation training, and 83% mean success on five real-world tasks.

Mon 28 SeptRobotics
The gist
Mobile manipulation lets robots move around while using their arms to do tasks, but it’s hard because the robot must understand its surroundings as it moves and plan arm and base actions together. The authors created MM-ABC, a system that helps robots see their environment better, coordinate arm and base movements, and imagine future states to improve planning. They trained MM-ABC on a huge variety of robot data and tested it on multiple benchmarks and real robots, showing better success in completing tasks than previous methods.
Open → 2609.35652v1