Atmospheric turbulence effects reduced using triple neural networks
TriINR: Unsupervised Atmospheric Turbulence Mitigation with Triple Implicit Neural Representations
Computer Vision and Pattern Recognition
Summary
Long-distance images often look blurry or wobbly because of atmospheric turbulence, which shifts and distorts them over time. The authors propose TriINR, a method that uses three connected neural networks to learn and separate the sharp image, the wobbly shifts (tilt), and the blurring all at once. This approach does not depend on how many blurry frames it gets, making it more memory-efficient and accurate. They also add knowledge about how turbulence behaves to help the networks restore clearer images. Tests show TriINR works better than earlier methods, even on real-world scenes with unexpected movements.
What this means in practice
- •For surveillance operators: Improve long-range camera footage clarity in varying turbulence conditions without needing manual image labeling.
- •For astronomy imaging specialists: Enhance images from ground-based telescopes by reducing atmospheric turbulence distortions across multiple time frames.
Authors
Yuka Ogino, Rikuto Otsuka, Yuho Shoji, Takuya Ogawa, Takahiro Toizumi, Atsushi Ito
Abstract
Atmospheric turbulence degrades image quality in long-range imaging. The degradation is generally modeled with two spatio-temporally varying components, tilt and blur. Recent unsupervised turbulence mitigation methods have demonstrated the effectiveness of representing a sharp image as an implicit neural representation (INR). However, their tilt and blur representations remain frame-dependent, and the number of optimization parameters grows with the number of input frames. To address this limitation, we propose TriINR, an unsupervised turbulence mitigation method that recovers a sharp image from multiple degraded frames. TriINR represents the sharp image, tilt, and blur as three implicit neural representations. By modeling tilt and blur as spatio-temporal INRs, TriINR achieves frame-count-independent degradation representation and memory-efficient optimization. We further incorporate physical and statistical properties of atmospheric turbulence as constraints on the INRs to improve restoration accuracy. Experiments on synthesized turbulence data with three degradation strengths show that TriINR restores images more robustly across varying turbulence strengths than prior TM methods and achieves the highest accuracy among the evaluated unsupervised methods. Our method also demonstrates robustness on real long-range scenes containing additional non-ideal motion.