Tactile curiosity improves robot learning for manipulation tasks

Tactile Curiosity Drives Robot Interaction

RoboticsArtificial Intelligence

Summary

Robots usually learn by trying random actions, but this often wastes time moving without touching anything useful. The authors propose a way to make robots curious about what they feel through touch, guiding them to explore and learn manipulation skills better. By focusing on tactile feedback, the robot discovers how to grasp and move objects without needing help or rewards. This method also helps improve robots that already use vision and language to understand actions.

What this means in practice

  • For robotics engineers: Train robots to learn object grasping and manipulation more efficiently by focusing exploration on tactile sensations.
  • For robot software developers: Enhance vision-language-action models by post-training them with tactile exploration data to improve manipulation performance.

Authors

Klemens Iten, Alexander Proshkin, Bhavya Sukhija, Stelian Coros, Andreas Krause, Pieter Abbeel, Carmelo Sferrazza

Abstract

Mastering robot manipulation skills via reinforcement learning (RL) remains largely sample-inefficient. The most common RL algorithms rely on random action sampling to discover new strategies, resulting in agents that allocate most of their training budget to motions in free space, away from the contacts from which manipulation skills emerge. Existing intrinsic motivation methods based on model disagreement or epistemic uncertainty improve on isotropic noise, but they can also reward uncertainty in functionally irrelevant transitions, such as erratic motions in free space. In this work, we argue that tactile feedback provides a natural signal for exploration, and introduce TacEx, a framework that incorporates touch into epistemic uncertainty-driven exploration by decomposing model uncertainty across sensory modalities and directing curiosity toward the tactile channel. By anchoring curiosity to the sense of touch, TacEx drives the robot to discover complex contact dynamics, learning to manipulate and grasp objects without task rewards or expert demonstrations during exploration. The interaction-dense dataset collected through this tactile-driven curiosity supports offline learning of downstream pick-and-place policies without additional environment interaction. We further use tactile-driven exploration to post-train vision-language-action (VLA) models. Although the VLAs are initially pre-trained without tactile feedback, post-training with TacEx substantially improves downstream performance while remaining highly sample-efficient.