PhotoGuider picks best view and crops for 360 degree photos
PhotoGuider: Composition-Aware Cropping and 360$^{\circ}$ View Framing with Explainable Photographic Assessments
Computer Vision and Pattern Recognition
Summary
Choosing the right direction to look and how to crop a 360-degree photo is tricky because the best scene isn't obvious at first. The authors created PhotoGuider, which finds good viewing angles and frames photos by measuring important composition qualities like subject, balance, and overall beauty. It also explains why certain views and crops were selected. Their method works better than other cropping tools and helps people pick more appealing frames from panoramic images.
What this means in practice
- •For photo editing software developers: Integrate direction selection and cropping tools that choose and explain the best framing for 360-degree photos automatically.$Commercial implications: Enables photo editing apps to offer smarter panorama framing features that attract users wanting easy and high-quality 360 photo crops.
- •For virtual reality content makers: Select appealing views and frames from 360 scenes to create better VR content presentations.
Authors
Yuan-Kang Lee, Kuan-Lin Chen, Chia-Che Chang, Yu-Lun Liu
Abstract
Traditional image cropping assumes the photograph already contains the composition worth keeping, and asks only where to crop. A full 360$^{\circ}$ scene offers no such guarantee: the viewing direction in a scene has to be discovered before anything can be framed. We present PhotoGuider, a measure-then-frame method that answers both questions with compact learned scorers over one shared set of composition-aware features. The designed features are extracted using foundation and task-specific vision models and structured into four photographic tokens: Subject, Composition, Aesthetics, and Integrity. Our MLLM explainer is fine-tuned to generate composition-related explanations conditioned on images and measured token assessments. To our knowledge, PhotoGuider is the first method to combine explicit composition-based direction selection in 360$^{\circ}$ panoramas with refined framing, camera-parameter output for native re-rendering, and measurement-conditioned explanations. On two standard 2D cropping benchmarks, PhotoGuider achieves the highest average mIoU performance against ground-truth crops. In a blind ranking study, 120 participants ranked three cropping methods over 100 panoramic scenes from the public Poly Haven HDRI library, placing our framings first in 53.2% of cases, against 27.3% and 19.5% for two strong alternatives. Project page: https://ntuneillee.github.io/research/photoguider/