Object focused maps update points to handle changes and errors

Point-Level Refinable Semantic Mapping for Spatial Understanding

Robotics

Summary

Mapping environments for robots usually means saving lots of points that tell where things are. But when objects move or things get seen wrong, old maps keep wrong points forever. The authors created a method that gives each point a confidence score, which changes over time based on new views and checks, helping the robot know which points are still trustworthy. This way, the map gets better, ignoring old or wrong parts as objects move or disappear. Their system works well in tests and helps robots navigate and answer questions about their surroundings.

What this means in practice

  • For robot developers: Maintain accurate maps that update object details as conditions change for better navigation and interaction in real-world scenes.
  • For augmented reality creators: Create spatial maps that adapt to moving objects and noisy data to improve user experience in dynamic environments.

Authors

Taimeng Fu, Yi Du, Zitong Zhan, Qiwei Du, Shaoshu Su, Zhipeng Zhao, Chen Wang

Abstract

Open-vocabulary 3D semantic maps have emerged as a key spatial memory representation for long-horizon robot autonomy, enabling robots to reason about objects, their spatial relationships, and past observations across time. However, existing object-centric semantic maps are primarily designed for static environments and rely on an append-only point integration strategy, where newly observed points are accumulated but previously integrated points are rarely reevaluated. Consequently, perception errors accumulate over time, and outdated points persist after objects move or disappear. Although recent dynamic mapping methods update object-level representations in changing scenes, they do not explicitly revise noisy or obsolete points within each object. We propose an online refinable semantic mapping framework that continuously refines object representations through probabilistic point-level confidence updating. Each object point maintains a confidence score that is updated online using multi-view temporal evidence: consistent observations reinforce reliable points, while inconsistent segmentation masks, depth measurements, and visibility cues suppress spurious and outdated points. Combined with object tracking and re-identification to preserve instance identities under motion and relocation, our framework enables object-centric semantic maps to be continuously refined rather than monotonically accumulated. Experiments demonstrate improved mapping accuracy over the previous method by 3.46% on Replica and 2.55% on ScanNet, show robustness in dynamic environments and under perception noise, and provide an effective spatial memory for object navigation and embodied question-answering with success rates of 82.4% and 76.7%.