3R-Adapter improves 3D reconstruction in low light and complex scenes

3R-Adapter: Retrieval, Rewiring, and Refinement for Efficient Adaptation of 3D Reconstruction Model

Computer Vision and Pattern Recognition

Summary

3D models that reconstruct objects and scenes from images can struggle when conditions are unusual, like in low light or when people and scenes are mixed. The authors found that a common problem is the loss of relationships between different views, which causes errors in matching parts of the scene. They created a method called 3R-Adapter that fixes these relationships by retrieving helpful connections, rewiring attention between views, and refining results for clearer 3D reconstructions. Their approach makes existing 3D models work better in challenging cases without needing heavy retraining.

What this means in practice

Authors

Zixiang Ai, Zhenyu Cui, Xu Zou, Jiahuan Zhou

Abstract

Feed-forward 3D reconstruction models have demonstrated strong generalization under large-scale pre-training, yet they struggle in long-tail scenarios such as low-light reconstruction, joint human-scene reconstruction, and test-time adaptation. We observe relational attention structure collapse, manifested as the failure of cross-view correspondences, as a primary cause of these limitations. While adaptation offers a practical way to bridge this gap, existing parameter-efficient fine-tuning (PEFT) approaches mainly perform channel-wise feature adjustment and lack mechanisms to explicitly adapt relational structures, leaving correspondence failures unresolved. In this work, we formulate adaptation of 3D reconstruction models as a problem of correspondence recovery under domain shift and propose 3R-Adapter, a PEFT paradigm for long-tail 3D reconstruction scenarios. Our method consists of three components: Deformable Retrieval for task-adaptive relation candidate retrieval, Relational Rewiring for reconstructing cross-view relational structures, and Consistency Refinement for injecting the rewired relations into stable predictions. Extensive experiments on low-light reconstruction, joint human-scene reconstruction, and test-time adaptation demonstrate that our approach significantly improves robustness over existing PEFT methods while maintaining efficient lightweight adaptation. Our code is released at https://github.com/PKU-OV3-LAB/3R-Adapter.