Volleyball 3D reconstruction improves player and ball tracking accuracy
Volley3D: Unified 3D Full-Sequence Reconstruction from Monocular Broadcasts
Computer Vision and Pattern Recognition
Summary
Figuring out the full 3D positions of players and the ball in volleyball games from just one TV camera is very hard because the camera moves and volleyball moves in complex ways like high jumps and quick ball hits. The authors created a new method that does not need 3D training data and uses physics ideas to correct errors caused by the camera’s perspective and reconstruct the ball’s path. Their system breaks down the ball’s movement into smaller parts and matches collisions to improve accuracy. Tests show their approach tracks players and the ball in 3D much better than simpler methods that just guess from 2D images.
What this means in practice
- •For sports analytics teams: Generate accurate 3D player and ball trajectories from single-camera volleyball broadcasts to improve automated game statistics and analysis.
- •For sports ar/vr developers: Create immersive 3D replays of volleyball matches for augmented or virtual reality experiences using monocular broadcast footage.$Commercial implications: Enables production of realistic 3D VR sports replays from casual broadcasts, expanding market offerings in sports entertainment.
Authors
Noâm Boussouf, Adrien Maglo, Mohamed Chaouch, Hideo Saito
Abstract
3D reconstruction from single-view sports broadcast is a pivotal capability for automated analytics and immersive AR/VR replays, yet notoriously ill-posed due to difficult-to-calibrate moving cameras and depth ambiguity. Unlike widely studied racket sports, team sports such as volleyball feature unpredictable multi-contact sequences and high altitude jumps. These dynamics categorically invalidate the standard planar projection assumptions relied upon by existing methods. To resolve these limitations without 3D training supervision, we propose a complete, physics-grounded pipeline tailored to monocular broadcast volleyball. First, we include a correction module to the perspective drift induced by ground-plane projection by coupling temporal jump spotting with Newtonian interpolation for 3D player placement. Second, for 3D ball trajectory estimation, we design a dedicated sub-trajectory segmentation architecture alongside a collision-matching algorithm. By anchoring physical equations to reconstructed 3D hand vertices, we lift noisy ball 2D detections into a spatiotemporally coherent 3D scene. Evaluations on multi-camera benchmarks demonstrate our approach significantly reduces 3D spatial drift compared to 2D-reprojection baselines.