Papers for

live event streamers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multimodal system helps edit concert videos from multiple cameras

Multimodal Concert Video Editing: System Design and Exploratory Evaluation

Abstract: Editing multi-camera concerts requires coordinated decisions about musical relevance, visual quality and cut timing. We present a modular framework that combines instrument activity from multitrack audio, visible instruments and image sharpness with beat-based timing and probabilistic camera selection. An interpretable scoring model links these components to the choice of views over complete shot intervals. Component tests and an exploratory expert study on a four-camera concert yield mixed assessments across the editing variants. The findings motivate extending local audiovisual relevance with contextual and sequence-level criteria. The architecture provides a basis for testing these extensions and studying how component behaviour affects the quality of complete edits.

Mon 26 OctMultimediaComputer Vision and Pattern RecognitionSound
The gist
Editing videos of multi-camera concerts is tricky because editors must choose the best camera view at the right time, balancing what instruments sound and look most interesting. The authors created a system that scores different camera shots by combining information about which instruments play, which are visible, how clear the image is, and the music beat. They tested this system with experts on a four-camera concert and found mixed results, suggesting that future work should include more context and consider longer sequences of shots. Their system design can help researchers test these improvements and understand how different parts affect video quality.
Open → 2610.35816v1