Context aware explanations improve trust in robot navigation for the blind
Navigation Explainability for Object Avoidance with LLMs for Assistive Robots
Robotics
Summary
Blind or visually impaired people often find it hard to understand why guide robots or dogs move in certain ways to avoid obstacles. The authors created a system that uses a large language model to explain these movements in simple sentences by combining what the robot sees with its planned path. They tested this on a robot indoors and found that explanations which include both obstacle details and future movement boosted users' trust and satisfaction the most. This shows that clear, context-rich language can make assistive robots easier to trust and use.
What this means in practice
- •For assistive robot developers: Create navigation systems that explain obstacle avoidance in conversational language to improve user trust.
- •For mobile robot interface designers: Design user interfaces for indoor robots that include context-aware explanations of future paths to enhance transparency.
Authors
Courtney Young, Yi Lian, Taery Kim, Sehoon Ha
Abstract
Blind and visually impaired individuals face uncertainty when navigating unfamiliar areas. Whether a cane or a guide dog is used for navigation, this may prove to be challenging. To mitigate this challenge, we present the Context-Aware Navigation Explanation framework that explains guide dog movements for obstacle avoidance and navigation using a large language model. This system integrates perceptual context with planned future trajectories to generate natural-language explanations of robot movement. We deploy the system on a Unitree Go2 platform in indoor navigation scenarios and evaluate how different explanation context configurations affect user trust and explanation satisfaction. Results show a strong positive relationship between explanation satisfaction and trust, and suggest that combining obstacle information with future trajectory leads to the most effective explanations. These findings highlight the potential of context-aware language explanations to improve transparency and trust in assistive robot navigation.