Papers for

video content analysis teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Long video reasoning model improves question answering accuracy

Long-to-Short Video Evidence Reasoning for Grounded Question Answering

Abstract: We present LOVER, a \underline{L}ong to sh\underline{O}rt \underline{V}ideo \underline{E}vidence \underline{R}einforced model for grounded question answering (GQA). LOVER highlights three innovations over existing reinforcement-learning (RL) based video reasoning models: (1) \textbf{Long-to-short Video Evidence Curriculum Learning}, which organizes RL training according to evidence duration and progressively adapts the model from long-range grounding to short-term reasoning; (2) \textbf{GQA Rewards}, which underscore the benefit of IoP reward over IoU for evidence spotting rather than strict temporal span overlap; (3) \textbf{Adaptive Timestamp Rendering}, which adaptively renders timestamps onto video frames using background-aware position and color selection to enhance temporal observability. The three designs are model-agnostic and reciprocal. They effectively improve QA, grounding, and grounded QA performance over different backbones. Notably, LOVER built on Time-R1 achieves new state-of-the-art (SOTA) results among open-source models on popular GQA benchmarks: NExT-GQA and ReXTime. Comprehensive ablation studies further validate the effectiveness of our three innovative components.

Mon 14 SeptComputer Vision and Pattern Recognition
The gist
Answering questions about videos often requires understanding what happens over different time periods. The authors introduce LOVER, a model that learns by first focusing on longer video parts and then shorter ones, improving its ability to find the right video evidence to answer questions. They also designed better ways to reward the model when it spots important video segments and made timestamps easier to see on videos. Their approach works with different underlying systems and sets new performance records on popular video question datasets.
Open 2609.15224v1