Panorama generation method reduces distortion and improves seamless viewing

Squaring-the-Sphere: Distortion-Free and Seamless Panorama Generation via CubeAtlas

Computer Vision and Pattern Recognition

Summary

Making 360-degree panoramic images usually means choosing between two problems: either the image looks distorted or it has visible seams between parts. The authors created a new way to combine cube-shaped image pieces into one layout called CubeAtlas, which keeps the correct perspective and avoids seams. Their technique also uses smart computer attention to improve image quality while reducing the work needed. They also developed a method to sharpen the details without extra training. Their approach produces clear, consistent, and distortion-free panoramas.

What this means in practice

  • For virtual reality developers: Create more realistic and seamless 360-degree environments with less distortion and improved detail.
  • For video game designers: Generate high-quality panoramic backgrounds that maintain geometric fidelity and avoid seams for immersive gameplay.

Authors

Xuhui Zuo, Chenjie Cao, Tengfei Wang, Junta Wu, Yisu Zhang, Chunchao Guo

Abstract

Generating 360-degree panoramas requires both local perspective fidelity and global spherical continuity. Existing representations face a trade-off: equirectangular projection (ERP) enables seamless panorama modeling but suffers from severe distortion and a domain gap to pre-trained image generators, whereas cubemaps preserve perspective geometry but often produce inconsistent faces and visible seams. We present Squaring-the-Sphere, a panoramic image generation framework built on a novel representation CubeAtlas, which unfolds all cubemap faces into a single compact canvas. By arranging orientation-aligned, rotated polar regions alongside the equatorial faces, this representation preserves the perspective geometry of cubemaps while organizing the cross-face relationships required for seamless panorama assembly. It further enables a pretrained diffusion transformer to model the complete panorama jointly in a single pass, without altering the backbone architecture or positional encoding. While CubeAtlas has a token count comparable to ERP, its structured layout makes many dense attention interactions unnecessary. We therefore introduce a layout-aware sparse attention mask that preserves the interactions required for panorama continuity while removing geometrically irrelevant token pairs. As a result, CubeAtlas achieves better quality than ERP modeling with lower attention computation. Furthermore, we introduce a training-free super-resolution technique and a fusion scheme that enhance fine details in distortion-free perspective space before achieving the final ERP panorama. Experiments on various benchmarks demonstrate that our method improves geometric fidelity, cross-view consistency, and high-resolution visual quality over previous methods.