Predictive coding helps robots balance internal models and real sensing
Predictive-Coding-Based Autonomous Regulation of Internally Generated and Externally Coupled Processing in Human-Robot Interaction
Robotics
Summary
Robots need to balance what they expect to happen with what they actually sense during interaction. The authors designed a system that lets a robot adjust how much it trusts its internal predictions versus new sensory input based on recent errors. This helps the robot respond more smoothly when humans interact with it physically. Their tests showed that this adjustment reduces conflicts and improves the robot’s behavior in different interaction scenarios.
What this means in practice
- •For robotics engineers: Develop robots that adaptively balance learned movement patterns and real-time sensory info during physical interaction with humans, improving safety and fluidity.
- •For rehabilitation therapists: Create assistive robots that dynamically adjust support based on patient motion variability during therapy sessions for better responsiveness.
Authors
Henrique Oyama, Hiroki Sawada, Jun Tani
Abstract
Predictive coding characterizes adaptive behavior as a dynamic balance between internally generated predictions and external sensory evidence, yet how an embodied cognitive system can regulate this balance online during ongoing interaction remains poorly understood. This study proposes a predictive-coding-based mechanism for regulating internally generated and externally coupled processing during physical human--robot interaction. The framework employs a predictive-coding-inspired variational recurrent neural network (PV-RNN), in which a meta-prior controls the degree to which posterior inference is constrained by learned prior dynamics. We extend this architecture with an online mechanism that uses reconstruction error accumulated over recent interaction history to select between predefined meta-prior regimes. The mechanism was evaluated across three physical human--robot interaction tasks involving fixed structured, changing structured, and less-constrained interaction. Across all tasks, lower meta-prior values produced the expected increase in posterior--prior divergence and reduction in reconstruction error. More importantly, reconstruction-history-driven regime selection was also associated with reduced prospective prediction error and robot-side physical interaction conflict, demonstrating consequences beyond the retrospective reconstruction objective itself. Task~3 further showed that recent sensory observations can be successfully accommodated while subsequent human motion still departs from the model's prior-generated future trajectory. Overall, these findings show that accumulated reconstruction mismatch can provide an endogenous signal for regulating how strongly subsequent inference relies on learned internal dynamics relative to ongoing sensory input during embodied interaction.