Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments
2026-08-24 • Computer Vision and Pattern Recognition
Computer Vision and Pattern Recognition
AI summaryⓘ
The authors address the problem of accurately figuring out where a robot or wearable device is in busy city areas where GPS doesn't work well. They created Spotter, a system that uses pictures of building fronts from Google Street View to help locate devices precisely in real time, even without GPS. Spotter first builds a detailed map from these images offline, then matches live camera views to this map to find the exact position. Tests on smart glasses in Barcelona show that Spotter is more accurate than methods relying only on movement tracking and works faster than other map-based systems.
visual localizationGPSurban canyonvisual odometrymap-matchingbuilding facadesemantic segmentationmulti-view stereogeometric verificationwearable smart glasses
Authors
Antoni Valls, Jordi Sanchez-Riera
Abstract
Accurate visual localization on robotic and wearable platforms remains challenging in dense urban environments. Existing methodologies typically rely on GPS for absolute positioning, yet GPS signals frequently degrade in urban canyons due to multipath propagation. Consequently, standard solutions like visual odometry suffer from unmitigated drift over time, while map-matching techniques struggle to acquire the reliable GPS priors they need, on top of being too computationally heavy for real-time edge execution. To address these limitations, we propose Spotter, a robuts and real-time visual localization framework that uses building facades as a reliable source of global geo-reference, while retaining the capability to integrate GPS signals when available. In an offline stage, Spotter processes Google Street View panoramas by semantically segmenting facades and pairing multi-view stereo depth with cartographic data to build a compact metric database. At runtime, query images are matched via a cascaded retrieval and geometric verification pipeline to recover fine-grained global camera localization. We benchmark Spotter on a newly collected dataset of pedestrian sequences acquired with wearable smart glasses across several districts of Barcelona. Experimental results show that Spotter outperforms odometry-based baselines and achieves localization accuracy comparable to state-of-the-art map-based methods while operating at significantly higher frame rates.