Papers for

live streaming teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Vidu S2 enables real-time editable interactive video with avatars

Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation

Abstract: We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing. Compared with Vidu S1, Vidu S2-Avatar supports real-time 720p video generation, generation with dynamic references that can be updated at any moment, and stronger instruction following, such as dancing. Vidu S2-Editing supports editing a video stream in real time, including style rendering, clothing replacement, character replacement, and background replacement. Experiments show that Vidu S2 outperforms all baselines. A playable online demo is available at https://vidu.com/vidu-stream.

Thu 10 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Creating and changing videos in real time is hard. The authors show Vidu S2, a tool that can generate live video of digital characters at 720p quality and lets users change styles, clothes, characters, or backgrounds while the video plays. It improves on an earlier version by allowing fast updates and more complex user commands like dancing. This system lets users interact instantly with video content, opening up new possibilities for live editing and avatar use.
Open 2609.11638v1