Material rebinding method transfers surface look while keeping shape intact
RATR: Training-Free Material Rebinding via Role Assignment and Temporal Routing
Computer Vision and Pattern Recognition
Summary
Changing the way an object looks on the surface without changing its shape is tricky because appearance and structure often mix together in images. The authors identified that features from the target and reference images get tangled, which makes transfers messy. They designed a new method called RATR that separates the shape information from the appearance cues in the images. This method uses a smart way to focus on just the shape of the target and just the material from the reference, making the result look more natural and accurate without needing to train a model first.
What this means in practice
- •For game developers: Update character or object surfaces with new material looks while preserving precise shapes during game asset creation.
- •For digital artists: Apply realistic material appearances from reference images onto 3D objects without training new models, speeding up creative workflows.
Authors
Jiehui Tang, Yunlong Yu, Zhao Wang, Jungong Han
Abstract
Material rebinding aims to transfer the material appearance from a reference image while preserving the target object's geometry and identity. Existing methods typically struggle to balance material fidelity with structural preservation due to the coupled influence of structural and appearance cues in their visual conditions. We identify role entanglement in the target and reference conditions as a contributing factor the target condition carries both geometry and its original appearance while the reference condition contains material cues alongside object-specific structure. To address this issue, we propose RATR, a training-free material rebinding method built on a diffusion-based image editor that assigns complementary roles to the two conditions and coordinates their influence during denoising. To make the target condition primarily convey structure, we introduce an albedo-resolved surface release mechanism, which suppresses the target's original surface appearance while retaining geometric cues, yielding a structure-oriented condition for material transfer. On the reference side, the designed material evidence isolation mechanism emphasizes material cues while reducing interference from object-specific structure, yielding a complementary material-oriented condition.