Adapting diffusion planners outperforms just switching experts in new areas

To Route or to Adapt? Multi-Expert Diffusion Planners in Unseen Regions

Robotics

Summary

When self-driving car planners face new or unseen locations, they can either choose from existing expert strategies or update their planning method to adapt. The authors found that simply picking among existing experts brings only small improvements, while fine-tuning the planner on a few new examples leads to much better results. Some quick fixes tested at runtime produced unrealistic paths, showing that adapting the planner is more effective than switching experts. This work helps understand how to improve trajectory planning in unfamiliar environments.

What this means in practice

  • For autonomous vehicle developers: Improve motion planning systems by fine-tuning planners on small target-region datasets instead of relying solely on pre-trained expert selection.
  • For robotics software engineers: Build adaptive trajectory planners that adjust to novel environments rather than expecting static expert models to cover all cases.

Authors

Yun Li, Ehsan Javanmardi, Simon Thompson, Jiachen Gong, Qunli Zhang, Zifan Zeng, Shiming Liu, Peng Wang, Yidu Zhang, Manabu Tsukada

Abstract

Diffusion trajectory planners with domain-specific experts face a practical question in unseen regions: can they rely on selecting among existing experts, or must the planner itself adapt? We study this question using a planner with a shared adapter and per-domain expert adapters. Across three real-world held-out maps, none of eight test-time routing schemes improves the fleet-mean lateral offset over the static default, which uses the same expert for every scene. Even an oracle that selects the best expert for each scene reduces the mean offset by only 0.9 m. In contrast, reward-based fine-tuning on just 20 target-region scenes yields substantially larger gains. On matched evaluation slices, joint replay achieves a fleet-mean offset of 6.9 m, compared with 12.4 m for the static default. Comparisons under the same target-region training budget show that target-region training drives the improvement, while replaying training scenes limits forgetting on the original ODDs. On nuPlan, fine-tuning across training cities also improves open-loop offsets, although closed-loop performance deteriorates. Further diagnostics reveal that two test-time adaptation baselines achieve low offsets by producing degenerate trajectories. These results show the limited headroom for selecting among existing experts and the greater open-loop gains available from adapting the planner.