Visual place recognition improves with reliability guided aggregation
Calibrating Retrieval Geometry: Reliability-Guided Training-Free Aggregation for Visual Place Recognition
Computer Vision and Pattern Recognition
Summary
Visual place recognition helps computers identify where a photo was taken by comparing image features. The authors found that fixed methods for combining these features can miss important details in new environments. They created a method called TFA that groups features reliably without needing extra training or labels. This method adjusts based on how consistent different feature sets are and can improve recognition accuracy in various challenging settings.
What this means in practice
- •For autonomous vehicle engineers: Enhance visual localization systems to better recognize places during driving without needing labeled data or retraining.
- •For drone navigation teams: Improve aerial view place recognition accuracy using reliable feature aggregation without task-specific model updates.
Authors
Xin Li, Zhimin Mao, Shang Wang, Siyuan Duan, Geng Zhang
Abstract
Frozen visual foundation models provide transferable features for visual place recognition, but fixed aggregation can suppress useful distinctions in new environments. We introduce TFA, a reliability-guided, training-free aggregation method requiring neither place labels nor task-specific weight updates. Our key observation is that reproducible retrieval need not be discriminative: independent codebooks can consistently retrieve a few database hubs. TFA combines cross-codebook agreement, retrieval coverage, and spectral statistics to control residual assignment, spectral shaping, and global-feature fusion. Its spectral kernel exactly recovers original descriptor similarity at zero intervention. Database-only TFA fixes its rules before accessing queries; TFA-C64 uses 64 disjoint unlabeled target images to calibrate retrieval for subsequent queries. Across 20 ground protocols with a fixed DINOv2-B backbone and matched resolution, database-only TFA improves Recall@1 over AnyLoc by 17.39 percentage points on MSLS-val and 9.55 on SPED. C64 mitigates failures of database-only calibration in driving environments. Across eight aerial/cross-view protocols, TFA achieves the highest Recall@1 among compared training-free heads in 14 of 16 DINOv2/DINOv3 backbone-protocol combinations. In a separate native-system comparison, DINOv2-G-based TFA-C64 reaches 91.46% Recall@1 on Pitts30k and 76.29% on VPAIR, outperforming the displayed training-free comparators on all five benchmarks. These results show that reliability-guided aggregation can recover additional retrieval capability from frozen representations, providing a practical baseline for new environments with scarce place supervision.