Ultrasound image clarity improved by new self-supervised despeckling method
Mask2Restore: Self-Supervised Ultrasound Despeckling via Inpainting
Computer Vision and Pattern Recognition
Summary
Ultrasound images used in medical scans have a grainy pattern called speckle that makes the pictures hard to read. This speckle is different from normal random noise because it depends on how tissues scatter sound waves. The authors created a new method called Mask2Restore that removes this grainy pattern without needing perfect clean images to learn from. Their approach masks blocks of pixels instead of single pixels to better handle the speckle’s pattern, and uses multiple image sizes to improve accuracy. Tests show this method keeps more fine details and helps with medical tasks like heart image segmentation.
What this means in practice
- •For medical image analysts: Enhance ultrasound images by reducing speckle noise while preserving small anatomical details, improving diagnostic image quality.
- •For medical device developers: Develop ultrasound machines with embedded despeckling software that improves image clarity without requiring clean reference images for training.$Commercial implications: Enables commercial ultrasound systems to offer clearer images through better noise removal adapting to clinical conditions.
Authors
Xuesong Li, Yingtai Xu, Zhongliang Jiang, Nassir Navab, Yuan Bi
Abstract
Medical ultrasound (US) is inherently degraded by speckle, a granular interference pattern that is often treated as a complex form of noise in image restoration. However, unlike random noise, US speckle originates from coherent scattering within tissue and is therefore highly spatially dependent and deterministic under fixed acquisition conditions, making US speckle suppression fundamentally different from natural image denoising. Because speckle-free US targets are unavailable in practice, self-supervised denoising is necessary. Blind-spot networks (BSN) are the dominant self-supervised paradigm for natural images, but their pixel-wise masking strategy assumes spatially independent noise, an assumption poorly matched to US speckle, which is spatially correlated over multiple pixels rather than pixel-wise independent. To address this mismatch, we propose Mask2Restore, a self-supervised US despeckling framework that reformulates despeckling as contextual inpainting with block-wise masking on single noisy images. Unlike pixel-wise BSN masking, block-wise masking addresses this multi-pixel speckle correlation by removing locally correlated speckle neighborhoods and shifting the reconstruction cues used by the network from adjacent speckle correlations to broader anatomical context. We further introduce cross-resolution context regularization (CRCR), which suppresses residual speckle bias by enforcing consistency across multi-resolution predictions. Experiments on simulated and in vivo carotid US, unseen fine-structure cases, and downstream cardiac segmentation demonstrate improved speckle-detail trade-offs, better preservation of fine anatomical structures, and practical value for subsequent image analysis.