CanonNav: Disentangling Navigation Behavior from Camera Geometry in Cross-Platform Visual Navigation
2026-08-31 • Robotics
Robotics
AI summaryⓘ
The authors propose CanonNav, a system that helps robots navigate using visual data from different cameras. They found that mixing camera types confuses the robot because it has to guess the camera's perspective, so they created a way to standardize the images and paths into a common format. Their method also teaches the robot safer and smarter path choices by using extra guidance from a travel safety model. Tests show CanonNav works better than others, even when only normal cameras are used.
visual navigationimitation learningcamera geometrycanonicalizationtrajectoriesRGB imagesoffline traversability estimatorsafety supervisionlocal-progress supervision
Authors
Dong-Wook Kim, Ji-Hoon Hwang, E-In Son, Mintaek Oh, Seung-Woo Seo
Abstract
While visual navigation has advanced through imitation learning from cross-platform demonstrations, fully leveraging such data remains challenging. First, directly learning from image-trajectory pairs entangles navigation behavior with platform-dependent camera geometry. This hinders consistent learning by forcing the policy to implicitly infer camera geometry from visual observations, an inherently ill-posed problem. Second, imitation learning from demonstrated trajectories captures the expert's chosen motion but leaves the intermediate decisions underlying that motion implicit. To address these issues, we propose CanonNav, a visual navigation framework that disentangles navigation behavior from camera geometry and incorporates complementary planning supervision into learning from cross-platform demonstrations. CanonNav introduces camera geometry canonicalization, which transforms visual observations and trajectories into a camera-consistent representation space. Building on this representation, we derive safety and local-progress supervision using pseudo-labels from an offline traversability estimator. Safety supervision penalizes unsafe trajectories, while local-progress supervision guides where the robot should advance. Experiments across diverse camera configurations and environments show that, despite using only RGB at inference, CanonNav consistently outperforms RGB-based baselines and even surpasses RGB-D-based methods in challenging scenarios.