Papers for

livestreaming app developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multimodal model improves fine camera tuning for livestream quality

Q-CamTuning: A Multimodal Large Language Model for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning

Abstract: With the popularization of livestreaming applications, automatic camera tuning has become indispensable for ordinary users to enjoy high Quality of Experience (QoE). However, the existing Image Quality Assessment (IQA) methods face two challenges in camera tuning. First, they struggle to identify subtle quality difference between images, which is common in camera tuning. Second, the ability to explain fine-grained differences and to provide suggestions for camera tuning are even more lacking. To address these challenges, we first construct FGLive-Comments, an instruction tuning dataset with rich annotations of both preferences for fine-grained image pairs and quality reasoning from global and local visual evidence, which supports selective adjustment recommendations of camera parameters. Based on FGLive-Comments, we develop Q-CamTuning, a multimodal large language model for livestreaming camera tuning. Its progressive perception-evidence-guidance framework learns quality-aware visual representations, enhances fine-grained reasoning with global-local evidence, and maps quality issues to camera-parameter adjustment directions. Extensive experimental results demonstrate that Q-CamTuning outperforms existing IQA models in both quality scoring and fine-grained image pair ranking. User study also validates its ability to recommend camera tuning suggestions.

Mon 2 NovComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Livestreaming video quality depends a lot on how well the camera settings are adjusted, but existing tools struggle to spot small differences in image quality and explain how to improve them. The authors created a new dataset that includes detailed comments about image preferences and quality issues to help a model learn. Using this data, they built Q-CamTuning, a system that can understand subtle image details and suggest precise camera setting changes. Tests show it outperforms previous methods for judging image quality and giving helpful tuning advice.
Open → 2611.03007v1