Context aware explanations improve trust in robot navigation for the blind

Navigation Explainability for Object Avoidance with LLMs for Assistive Robots

Robotics

Summary

Blind or visually impaired people often find it hard to understand why guide robots or dogs move in certain ways to avoid obstacles. The authors created a system that uses a large language model to explain these movements in simple sentences by combining what the robot sees with its planned path. They tested this on a robot indoors and found that explanations which include both obstacle details and future movement boosted users' trust and satisfaction the most. This shows that clear, context-rich language can make assistive robots easier to trust and use.

What this means in practice

Authors

Courtney Young, Yi Lian, Taery Kim, Sehoon Ha

Abstract

Blind and visually impaired individuals face uncertainty when navigating unfamiliar areas. Whether a cane or a guide dog is used for navigation, this may prove to be challenging. To mitigate this challenge, we present the Context-Aware Navigation Explanation framework that explains guide dog movements for obstacle avoidance and navigation using a large language model. This system integrates perceptual context with planned future trajectories to generate natural-language explanations of robot movement. We deploy the system on a Unitree Go2 platform in indoor navigation scenarios and evaluate how different explanation context configurations affect user trust and explanation satisfaction. Results show a strong positive relationship between explanation satisfaction and trust, and suggest that combining obstacle information with future trajectory leads to the most effective explanations. These findings highlight the potential of context-aware language explanations to improve transparency and trust in assistive robot navigation.