Papers for

media content platforms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Agentic video reasoning favors simple frameworks for long videos

SAVE: Less is More in Agentic Video Reasoning

Abstract: Agentic video-reasoning frameworks iteratively explore a video, choosing what to observe based on the query and evidence gathered so far. Existing methods are typically evaluated with different backbones, preprocessing pipelines, and computational budgets, making it difficult to determine which components actually drive performance, how much they cost, and whether agentic inference is preferable to native video reasoning in the first place. We conduct a controlled evaluation of a diverse set of recent agentic video-reasoning systems across two strong contemporary backbones, with explicit token and monetary-cost accounting. Across Gemini 3 Flash and Gemma 4, most existing agentic frameworks fail to consistently improve over native video inference and often increase computational cost. We investigate two primary questions: (1) How much agentic framework complexity is necessary for effective video reasoning? (2) When, if at all, is agentic video reasoning preferable to just using the backbone directly? To answer the first question, we introduce a deliberately minimal Active Exploration Baseline and show that it remains competitive with substantially more elaborate agents. We then propose targeted extensions to this baseline, yielding SAVE (Simple Agentic Video Explorer). SAVE outperforms all evaluated prior agentic methods in five of six backbone-benchmark settings. Turning to the second question, our results indicate that the advantage of agentic exploration grows when dense processing would otherwise represent answer-relevant events too sparsely, particularly for long videos and temporally concentrated evidence. Overall, our results suggest that agentic video reasoning should favor simple frameworks over increasingly elaborate pipelines and focus primarily on long-form video, where selective evidence acquisition offers the clearest advantage over native inference.

Wed 11 NovComputer Vision and Pattern Recognition
The gist
Sometimes computers need to watch videos and answer questions about them without watching everything in detail. The authors studied different ways for a computer to decide what parts of a video to watch carefully to answer questions better and faster. They found that simpler decision-making methods work as well or better than complicated ones, especially when the videos are long and important clues are spread out in time. This means focusing on simpler strategies can save effort and improve video analysis when handling lengthy videos.
Open → 2611.15079v1

Video memory system improves question answering on long videos

Write Once, Query Many: Evolving Compact Reusable Memory for Long Videos

Abstract: Long videos often exceed the context capacity of multimodal large language models (MLLMs), while agentic search repeats costly video processing and grounding for each query. Reusable memory can amortize this cost, but must preserve information for questions unknown during construction. We propose Video-EMem, an evolvable video memory harness built on time-anchored perceptual observations. This representation combines compact free-form text with sparse images to preserve semantic content and complementary visual details across temporal scales, supporting temporal navigation without a fixed semantic schema. A Writer encodes each video once by consolidating overlapping multiscale observations, and a Reader retrieves and organizes evidence solely from the resulting memory. With the underlying models frozen, we evolve their workflows and operators using distinct feedback: query-independent source fidelity and coverage for the Writer, and QA failures in evidence localization and utilization for the Reader. Experiments support this separation for generalization beyond development queries, with our evolution strategy improving average accuracy by 7.2% over the unevolved harness. While reducing storage by about 99.86% on average relative to raw videos, Video-EMem improves Qwen3-VL-30B by an average of 2.6% across three long-video QA benchmarks over direct input of 2,048 frames. Using the same o3 answer model as the state-of-the-art agentic method, it improves average accuracy by 2.5% with lower per-query latency.

Sat 17 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Long videos are hard for current AI systems to understand because they are too big to look at all at once. The paper introduces Video-EMem, a special way to create a compact memory from a video that keeps important visual and text details and can be reused to answer many questions without reprocessing the whole video. The system stores the video’s information efficiently and improves accuracy and speed when asking questions about the video. The authors show their method works better than just feeding parts of the video directly to AI models.
Open → 2610.24537v1

Sora100K dataset captures video creation as step-by-step editing process

From Video Clips to Creation Trajectory: Sora100K for AI-Native Video Creation

Abstract: AI-Native video creation is shifting from isolated video clips toward iterative video creation workflows. However, existing datasets remain largely video clips, representing video generation and editing as separate tasks rather than connected stages of a video creation workflow. In this paper, we introduce Sora100K, a dataset that represents the AI-Native video creation workflow as a structured video creation trajectory. Specifically, we first identify video creation trajectories and decompose them into three subsets according to their structural roles: text-to-video generation records as roots, single-turn video editing records as editing edges, and multi-turn video editing records as complete trajectories. Then, we use a VLM to assign semantic annotations for generation roots and editing-operation annotations for editing edges. A strict construction pipeline further reconstructs source-to-edit lineage, editing order, and intermediate video states while ensuring data quality. Finally, we perform lightweight adaptation on LTX-2 models to assess the supervision value of Sora100K. The results show improvements in visual quality, multi-shot generation, and cross-shot consistency, while successive-turn evaluation reveals that following multi-turn editing instructions remains challenging. Sora100K establishes a new data foundation for AI-Native video creation beyond isolated video clips and toward structured video creation trajectory. The dataset and supplementary materials are publicly available at https://huggingface.co/datasets/ysicong/Sora100K.

Thu 8 OctComputer Vision and Pattern Recognition
The gist
Creating videos with AI usually means making or editing single clips without connecting these steps. The authors introduce Sora100K, a large dataset that shows how videos are made through multiple steps, from text instructions to several rounds of editing. This dataset helps AI models learn the full video creation workflow, not just isolated tasks. Tests show improvements in video quality and consistency but also reveal that following multiple editing steps remains hard for AI.
Open → 2610.11770v1

Ai agents struggle with real video editing in finished deliverables

Timeline-Bench: Evaluating Agents on Realistic Video-Editing Tasks, from Raw Footage to Final Cut

Abstract: AI agents increasingly carry out long-horizon professional work, but their evaluations rarely require a finished creative deliverable. To this end, we introduce Timeline-Bench, a benchmark of 56 real video-editing tasks, each asking an agent to turn raw production material into a finished video. Tasks range from selecting dialog takes and shaping interview footage into a story to cutting commercials from product shots, voiceovers and graphics. Every task provides a brief, source assets, a container and a set of tests. A task is resolved when the output passes every test. The tests check the delivery format, the content and the brief's explicit requirements, and include a quality test calibrated on 2,582 blind judgments by 43 video editors. We evaluate 16 agents that pair frontier models with coding-agent harnesses such as Codex, Claude Code and OpenCode. The best, GPT-6 Astra in Codex with curated editorial guidance, resolves only 15 of the 56 tasks (26.8%), and the average agent resolves 14.0%. Human editors prefer the reference edit in 83.5% of judgments. Most unresolved runs (562 of 771) fail only the quality test: agents perceive footage through stills and transcripts and check their renders for defects, not craft. We release the tasks, verifier and per-run results at https://timelinebench.tensortest.com.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMultimedia
The gist
Video editing involves many complex steps, from choosing the right shots to assembling a polished final video. The authors created Timeline-Bench, a test set of 56 real video editing tasks, to see how well AI agents can complete these tasks from start to finish. They found that even the best AI agents only completed about one quarter of the tasks successfully, mostly failing the quality checks. Human editors preferred the original edits most of the time, showing that current AI still lacks creativity and finesse in video editing.
Open → 2609.35143v1

Large AI models struggle to understand cinematic storytelling techniques

CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models

Abstract: Cinematography, the craft of visual storytelling through framing, lighting, and camera operation, fundamentally shapes how audiences perceive and emotionally engage with video content. While Large Vision Language Models (LVLMs) have made remarkable progress in video question answering, existing benchmarks primarily focus on identifying low-level techniques rather than understanding their storytelling impact. To address this, we introduce CinematicVQA, the first-of-its-kind benchmark for cinematic video understanding that goes beyond technique recognition to evaluate film-grammar reasoning, utilizing our introduced Cinematic Scene Graph (CSG), a structured representation that links filming techniques to their perceptual effects and narrative functions. Through comprehensive evaluation of state-of-the-art LVLMs, we reveal a striking semantic gap: models consistently perform higher on describing visual presentations than on identifying the underlying techniques. Surprisingly, Chain-of-Thought prompting fails to provide consistent gains and degrades performance for most models, suggesting that current LVLMs lack sufficient cinematic domain knowledge to benefit from step-by-step reasoning. Fine-tuning on \textsc{CinematicVQA-train} yields consistent improvements, particularly for narrative function and multi-hop reasoning. Overall, \textsc{CinematicVQA} serves both as a rigorous benchmark for cinematic evaluation in LVLMs and as a practical dataset for training more film-aware video models.

Wed 23 SeptComputer Vision and Pattern Recognition
The gist
Understanding how movies tell stories visually is hard for AI models that see and read videos. The authors created a new test called CinematicVQA, which checks if AI can reason about the film-making methods behind what we see, not just describe the images. They found that AI models are better at describing scenes visually than explaining the storytelling tricks used, and common techniques to improve reasoning did not help. Training AI on this new test helped them get better at understanding narrative and multi-step story reasoning.
Open → 2609.28813v1

VideoX-Qwen enables instruction-based video editing with large data and models

VideoX-Qwen: Data-Centric Instruction-Based Video Editing

Abstract: Progress in general-purpose video editing depends on constructing large-scale paired supervision and effectively adapting video-generation backbones to instruction-driven editing. Unlike video generation, video editing must execute a requested transformation while preserving unrelated subjects, scene structure, motion, and temporal continuity. We present VideoX-Qwen, an integrated data-construction and model-training framework for general instruction-based video editing. Our scalable production pipeline organizes specialized generation and understanding models into complementary routes for addition, removal, replacement, and attribute editing, followed by quality screening and instruction enrichment. It produces more than 1.2 million directional video-editing records, including over 400,000 records in each major task group, with an automatic acceptance rate of 89%. The resulting corpus provides broad and structured coverage of common editing operations through a unified source-instruction-target interface. We further develop a unified Qwen-Wan editor that combines multimodal semantic conditioning with dense source-video latent guidance. A progressive image-video training strategy aligns the multimodal instruction interface, adapts the video generator to source-conditioned editing, and refines output quality with selected high-resolution data. In a 100-example comparison with UniVideo and Kling O1, VideoX-Qwen achieves the best mean result on nine of eleven reported metrics, including instruction following, editing quality, content preservation, structural and perceptual similarity, and video-distribution quality. Together, the large-scale data-production system and unified training framework provide a practical foundation for more capable instruction-driven video editing.

Tue 22 SeptArtificial IntelligenceGraphics
The gist
Editing videos so they follow detailed instructions while keeping the original motion and scenes intact is much harder than just creating videos from scratch. The authors developed VideoX-Qwen, a system that builds an enormous dataset of video editing examples by combining multiple specialized models to add, remove, replace, or change things based on instructions. They then trained a video editing model that understands instructions and maintains video quality. When tested, VideoX-Qwen showed better results than previous methods on many measures like following instructions and preserving content.
Open → 2609.26015v1