Neural texture compression improves image quality with anisotropic filtering

Explicit LOD-Conditioned Anisotropic Filtering for Neural Texture Compression

Graphics

Summary

Neural texture compression saves space when storing material images but usually treats every detail the same, causing blurry images near the camera. The authors created a way to teach the system to understand how images look from different angles and distances by using three geometric values that hardware also uses. Their method, called AF-NTC, creates sharper textures at much smaller sizes compared to standard methods. This technique improves visual details without needing large amounts of storage.

What this means in practice

  • For graphics engine developers: Enable finer control of texture filtering in compressed neural textures to improve rendering quality with less memory usage.
  • For video game artists: Create more detailed material appearances in games by using compressed neural textures that maintain clarity at varying distances and angles.

Authors

Shin Fujieda, Takahiro Harada

Abstract

Neural texture compression (NTC) stores material textures compactly, but the dominant feature-pyramid design receives no filtering from the GPU texture unit: it learns each material at a fixed UV and level of detail and has no explicit anisotropic-filtering (AF) mechanism. Setting the filter from the footprint aspect ratio alone is not enough: a single input cannot carry both the shape of the footprint and its size, so the image is too blurry near the camera by the same amount at every distance. Our method, AF-NTC, instead conditions the decoder on the same three bounded values a hardware sampler uses: minor-axis scale (LOD), aspect ratio, and major-axis orientation. These drive a tap line along the major axis and a level blend across the minor axis, and we train against anisotropically filtered ground truth. At $25\%$ of a full BC7 mip chain, AF-NTC beats the no-AF trilinear-BC7 baseline on all ten material--scene pairs we compare ($+1.3$ to $+7.6$\,dB), and it is $0.0$ to $3.4$\,dB below the $4\times$-larger anisotropic-BC7, depending on the material.