Spin neural operators improve learning of vector and spin fields on sphere

Spin Spherical Fourier Neural Operators: Efficient Equivariant Learning for Vector and Spin Fields on the Sphere

Computer Vision and Pattern RecognitionMachine Learning

Summary

Some important natural phenomena on the globe, like wind directions and cosmic light patterns, are represented by special fields called spin fields. These fields change depending on how you look at them locally, which makes them tricky for computers to understand. The authors developed a new kind of neural network layer that respects these changes exactly and works efficiently by using mathematical properties of the sphere. Their method performs better than previous ones on tests and works precisely even when the data is rotated.

What this means in practice

  • For climate modelers: Improve wind pattern predictions on global climate models by using spin-aware neural operators that handle vector field rotations exactly.
  • For astronomical data engineers: Enhance analysis of cosmic microwave background polarization data by applying spin-equivalent neural models that maintain rotational consistency.

Authors

Kevin Mulder, Matthew A. Price, Eirini Leftaki, Jason D. McEwen

Abstract

Many fields of physical interest on the sphere, such as wind, the polarisation of the cosmic microwave background and the shear of weak gravitational lensing, are spin fields, whose values change phase when the local frame rotates. We extend spherical Fourier neural operators (SFNOs) to fields of any spin, through lifted spherical convolutions that are exactly rotationally equivariant. Lifting spin fields to Mackey functions on the rotation group provides the conceptual framework, while computation is performed exactly and efficiently through their harmonic representation and by appealing to sampling theorems on the sphere and rotation group. We construct spin SFNOs (S$^2$FNOs) from these building blocks. We demonstrate empirically that rotational equivariance holds to machine precision for these layers. We achieve state-of-the-art performance on existing benchmarks, and introduce new benchmarks on which spin-aware models outperform their scalar counterparts.