Autonomous robots reconstruct and manipulate surgical threads live
Live Thread Reconstruction for Autonomous Manipulation
Robotics
Summary
Suturing stitches during surgery is a tricky, time-consuming task because the thread moves and twists in complex ways. The authors present a method that uses images to continuously track and rebuild the shape of the thread in real time. This helps a robot perform the suturing steps safely and efficiently, even as the thread bends, knots, or gets tangled. Their system improves the robot’s ability to handle these flexible threads during long and complex tasks.
What this means in practice
- •For surgical robotics teams: Perform continuous thread tracking and manipulation to automate complex suturing tasks during surgery.$Commercial implications: Enables autonomous robotic systems to conduct accurate, safe suturing during operations, improving surgical efficiency and reducing surgeon workload.
- •For industrial automation engineers: Automate handling of flexible cables or threads requiring continuous shape estimation and manipulation in assembly lines.
Authors
Emma Huang, Omar Hernandez, Zih-Yun Chiu, Michael Yip
Abstract
Autonomous robotic surgery has drawn increased attention in recent years due to its potential to relieve surgeons of time-consuming, mentally straining, and tedious tasks, particularly during prolonged operations. One suitable task for automation is suturing, which involves tracking the thread as it deforms during needle retrieval, de-tangling, knot tightening, and other tasks. Unlike rigid-object manipulation, deformable thread manipulation has no fixed pose to track and effectively infinite degrees of freedom, making its configuration difficult to predict and requiring the thread's state to be re-estimated rather than assumed. At the same time, thread manipulations involve sequential motions that depend on past and current thread contact points, which must be accurately and continuously tracked. This paper presents an image-to-manipulation pipeline that concurrently generates live thread reconstruction while conducting safe and optimized sequential manipulations to achieve long-horizon tasks.