Structure aware matching improves drone thermal image localization

Structure-Aware Matching for Robust UAV Thermal-to-Satellite Geo-Localization

Computer Vision and Pattern Recognition

Summary

Finding a drone's location using heat-based images is hard because these images look very different from satellite photos. The authors created a new method called SAMF that focuses on matching stable shapes and lines in the images, rather than colors or brightness. This approach helps the drone figure out where it is even in tough, low-visibility situations. They also made a new dataset to test their method and showed it works better than previous ones.

What this means in practice

  • For drone navigation teams: Improve drone navigation by accurately locating UAVs from thermal images when GPS signals are unavailable or conditions are poor.
  • For search and rescue operators: Enhance location tracking of drones using thermal cameras in low visibility for emergency response and disaster management.

Authors

Chun Liu, Yuxin Wang, Zhenxiang Huo, Linlin Zhu, Tao Xu, Henggang Han

Abstract

UAV thermal-to-satellite geo-localization localizes UAVs by matching real-time thermal images against georeferenced satellite images, enabling autonomous navigation in GNSS-denied and low-visibility conditions. However, substantial cross-modal disparities in color, brightness and viewpoint hinder conventional appearance-based methods from establishing reliable correspondences. While existing approaches predominantly address global modality shifts, they overlook the invariant scene structures inherently shared between thermal and satellite views. To bridge this gap, we propose SAMF, a Structure-Aware Matching Framework that explicitly exploits stable cross-modal structural cues to improve UAV thermal geolocalization. Specifically, the Directional Structure Enhancement Module (DSEM) strengthens robust structural representations by capturing directional and low-frequency spatial patterns, and the Modality-Aware Affine Remapping Module (MARM) subsequently applies affine correction to these enhanced features, further promoting cross-modal alignment. Additionally, we introduce the Thermal-UAV-Paired benchmark derived from the Thermal-UAV dataset. Extensive experiments on both the Boson-nighttime and Thermal-UAV-Paired datasets show that SAMF achieves state-of-the-art performance. Ablation studies further validate the effectiveness and synergistic complementarity of DSEM and MARM. The code and dataset are released at: https://github.com/YuxinWang879/SAMF.git.