Papers for

film and animation teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Benchmark measures memory and consistency of video world models

WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models

Abstract: As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requires both preserving previously observed content and ensuring coherent world evolution over time. World memory is a critical capability to evaluate alongside visual fidelity and video duration. We introduce WorldMemBench, a benchmark for systematically evaluating world memory in video world models. Across 260 test cases, it assesses static memory through the retention of human identity and appearance, object appearance and geometry, and environmental content and geometry, and dynamic memory through event progression and state persistence. Using controlled camera departures and multi-revisit trajectories, the benchmark evaluates static content against fixed initial references and dynamic events against expected state transitions. It combines appearance and geometry metrics with event-specific assessments, and reports video quality and camera-following accuracy as complementary diagnostics. Evaluation of nine representative models shows that strong static retention does not imply reliable dynamic state evolution, while repeated revisits reveal memory degradation beyond the first return. Human studies support the alignment between our automatic evaluations and human judgments. WorldMemBench provides a systematic testbed for diagnosing memory failures and guiding the development of persistent, temporally coherent video worlds.

Tue 13 OctComputer Vision and Pattern Recognition
The gist
Keeping track of things seen in videos over time is important for creating realistic interactive experiences. The authors created a new set of tests, called WorldMemBench, to check how well video AI models remember people, objects, and events. Their tests look at both static details like appearance and dynamic changes like events unfolding correctly. They found that being good at remembering static things doesn’t always mean the model handles changes over time well. They also showed that their automatic scores match what people think about video quality and memory accuracy.
Open → 2610.19063v1