Beyond Spherical Harmonics: Rethinking Appearance Models for Radiance Reconstruction

2026-06-08Computer Vision and Pattern Recognition

Computer Vision and Pattern RecognitionGraphics
AI summary

The authors study how to better capture how objects look different from various angles, which is hard and usually needs lots of memory. They tested many mathematical functions to represent these view-dependent effects and introduced a new function called the Normalized Anisotropic Spherical Gabor. This new method models sharp details like shiny spots more accurately while using much less memory. They showed it works well in tasks that rebuild scenes based on how light behaves, making it a useful tool for 3D reconstruction.

view-dependent appearancenovel-view synthesisspherical harmonics (SH)high-frequency effectsspecular reflectionsspherical functionsGabor functionradiance field reconstructionmemory efficiencyanisotropy
Authors
Ewa Miazga, Jorge Condor, Piotr Didyk
Abstract
View-dependent appearance modeling remains a challenging problem in novel-view synthesis and reconstruction. Accurately representing complex angular effects often requires substantial memory and computational resources. For new learning-based methods, a common approach is to rely on SH. However, capturing high-frequency phenomena such as specular reflections demands high-order expansions, which increase memory usage and computational cost. Consequently, most methods employ low-order SH, which limits the ability to model complex view-dependent effects, resulting in overly smooth or diffuse representations. To address these limitations, we systematically evaluate a wide range of spherical functions in the context of scene reconstruction. Some of them are introduced to graphics and computer vision for the first time in this paper. Based on the insights from the experiment, we develop a novel spherical formulation, the Normalized Anisotropic Spherical Gabor function that enables efficient modeling and learning of high-frequency appearance effects while maintaining compact representation. Compared to existing approaches, our function achieves higher-quality reconstruction of view-dependent phenomena such as glints, while being up to five times more memory-efficient and more efficient to evaluate. We validate its performance in radiance-field reconstruction tasks.