Visual Cue Interactions in AR-Guided Needle Insertion: A Prostate Biopsy-Inspired Phantom Study
Graphics
Summary
The authors studied how augmented reality (AR) can help doctors guide needles inside the body during procedures like biopsies. They tested three ways to show helpful visuals: a zoomed-in window, colors that show needle closeness, and a path line showing where the needle will go. Their study found that beginners did better with the path line, while experts worked faster when using the zoomed window or color cues. The authors suggest that the best AR help depends on the doctor's experience and how visuals are shown together.
augmented realitypercutaneous needle procedureultrasound imagingneedle guidancevisualization techniquesfocus-and-context windowcolor proximity encodingtrajectory overlayuser expertisebiopsy phantom
Authors
Xinrui Zou, Mingxu Liu, Thomas T. Jones, Braden Millan, Sandeep Gurram, Peter A. Pinto, Raisa Z. Freidlin, Alejandro Martin-Gomez
Abstract
Despite the apparent simplicity of the motor action involved during percutaneous needle procedures, manipulating the tool's direction becomes challenging when clinicians cannot directly visualize internal anatomy and must rely on ultrasound images, which increase cognitive demand. Augmented reality (AR) offers the promise to assist with these tasks by providing pertinent visual information in the clinician's field of view. However, simply providing visual information that ignores meaningful visual cues can complicate depth perception and spatial understanding. In this work, we introduce and evaluate three visualization techniques for needle alignment developed during design sessions with medical experts: a localized focus-and-context window, a color-based proximity encoding, and an explicit trajectory overlay. These techniques were evaluated in a user study (n=26) including clinical experts (n=7) using a prostate-biopsy-inspired phantom. Results from this study suggest that cue effects depended on the surrounding cue configuration and user expertise. For novices, explicit trajectory overlay improved targeting accuracy and reduced retreat behavior, but its effect on completion time varied across cue configurations, with slower performance when the overlay was presented alone. For experts, the focus-and-context window reduced completion time and retreat events, while color-based proximity overlay improved completion time. Subjectively, color cues were often perceived as helpful even when their effects on accuracy were not consistent. These results suggest that AR guidance strategies for percutaneous interventions should consider user expertise and visual context.