Papers for

film animators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Source preserving method improves text based human motion editing

SuperMotion: Source-Preserving Denoising for Text-Driven Human Motion Editing

Abstract: Text-driven human motion editing aims to realize a requested change while preserving compatible source content. Existing diffusion editors rely largely on learned conditioning for preservation of the unedited part, yet their outputs can lose temporal detail as denoising proceeds. We propose the \textbf{Source-Preserving Denoising framework (SuperMotion)}, which explicitly reuses the source at each reverse step for source preservation. We first align the source motion to the output timeline and predict a preservation gate that controls reuse across frames and feature dimensions. A clean-space source anchor then utilizes the learned preservation gate to blend the predicted clean motion with the aligned source and passes the corrected estimate directly to the sampling posterior. Because the aligned source is a realized motion rather than a regression output, the anchor injects sample-level temporal detail that a reconstruction-trained denoiser tends to smooth away. To learn effective source reuse, we supervise the anchored estimate against the editing target and match its second temporal differences through a temporal high-frequency loss. These objectives require no explicit edit masks. Extensive experiments show that SuperMotion improves editing accuracy, reaching 33.20\% full-pool R@1 on MotionFix, while reducing temporal-detail attenuation and preserving motion dynamics as it realizes the requested changes. Ablations confirm that the learned preservation gate is responsible for the gain and that it reuses the source to retain the unedited content properly.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Editing human motion using text instructions can change some parts while keeping others the same, but existing methods often lose smooth movement details. The authors proposed a new technique called SuperMotion that keeps using the original motion as a reference throughout the editing process to better preserve these details. Their approach blends the predicted changes with the aligned original motion, improving accuracy and keeping natural movement dynamics. This method works without needing extra information on which parts to keep unchanged.
Open → 2610.01517v1

Timo improves human motion generation from text using multimodal transformers

Timo: $\textbf{T}$aming Mult$\textbf{i}$modal Diffusion Transformer for Human $\textbf{Mo}$tion Generation

Abstract: Most existing human motion generation (HMG) methods use cross-attention modules to inject text semantics, but ignore the importance of bidirectional modeling between motion and text tokens, which limits text comprehension. A straightforward idea is introducing multimodal diffusion transformers (MMDiT), which have shown effective joint text--visual modeling in vision generation, into HMG. However, we find that articulated motion is temporally coherent but weakly correlated across joints, in which directly applying an MMDiT with flow matching produces poorly coordinated and jerky motion. In this work, we propose Timo, a novel kinematics-aware MMDiT framework tailored for HMG. Timo combines fully shared multimodal attention for bidirectional text--motion modeling with flow matching, geometric and rotational-kinematics supervision that compares actual rotations and their changes over time, and a two-stage curriculum progressing from broad motion learning to detailed caption alignment. Further, we construct a benchmark of $40{,}025$ held-out clips from six public datasets spanning diverse actions, assessing six complementary dimensions under a common evaluator and scoring protocol. Our model substantially outperforms state-of-the-art methods in both quantitative and qualitative evaluations. Remarkably, Timo surpasses Kimodo on five of six dimensions, achieving a $40.8$% relative improvement in the average benchmark score. Project page: https://kyfafyd.wang/projects/timo. Demo page: https://timo.kyfafyd.wang.

Fri 25 SeptComputer Vision and Pattern Recognition
The gist
Generating human movements from text descriptions is a challenge because motions are complex and need to smoothly coordinate different body parts. The authors show that existing methods do not fully understand the connection between text and motion. They introduce Timo, a new system that better models this relationship by combining advanced transformers with special techniques that respect human joint motions and rotations. Their method creates more natural and detailed movements and performs much better than previous approaches on a large, diverse test set.
Open → 2609.30761v1

VISTA creates stylized 3D human motion from text and video style

VISTA: Video-Injected Stylized Text-to-Animation

Abstract: We present VISTA, a two-stage framework for generating stylized 3D human motion by fusing structural content from text prompts with expressive style from reference videos, without requiring jointly paired (text, video, stylized motion) triplets. A Dual-channel Autoencoder first maps motion sequences and video clips into a shared latent manifold. A masked autoregressive diffusion backbone then operates within this manifold, injecting video-derived style through a dedicated late-fusion Dual-AdaLN pathway while preserving text-conditioned content structure. A cross-batch unpaired training protocol with latent cycle consistency enables joint learning across separate semantically rich and stylistically diverse datasets. As a proof-of-concept for controllable animation synthesis, we validate VISTA on rendered motion-capture references: it achieves the highest style recognition accuracy among video-conditioned methods while preserving competitive content alignment, and its decomposed 3-way classifier-free guidance provides independent, user-controllable calibration of the content--style balance at inference time.

Sun 20 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Generating 3D human animations that match both a description and a style can be tricky when datasets don’t have matching text, video, and motions combined. The authors introduce VISTA, a method that learns from separate text and video sources to produce motion that aligns with a text prompt while adopting the style from a reference video. It uses a special autoencoder to blend these inputs into a shared space and a diffusion model to generate animations that keep the content accurate and style expressive. Their approach lets users balance how much the animation follows the text versus the style during creation.
Open → 2609.23817v1

Flexible human motion created from language and style examples

Flexible Motion Generation from Language and Style References

Abstract: We introduce FlexMoGen, a novel framework for flexible human motion synthesis conditioned on both natural language descriptions and motion style references. Text prompts are effective at defining semantic content, but they are often limited in capturing fine-grained style details such as timing, limb articulation, and expressive dynamics. A style example clip supplements the text by conveying these nuanced motion characteristics directly, enabling the model to preserve high-level intent while reproducing the desired stylistic traits. Given a text prompt and a style example clip, FlexMoGen generates high-quality motions that preserve semantic content while faithfully reflecting the target style, offering users greater control over the animation generation process. Unlike prior methods that rely on discrete style labels and do not generalize to long or multi-style generation, FlexMoGen learns a variational style encoder without style supervision and supports long, time-varying, multi-style synthesis. Our framework jointly pre-trains the style encoder and a text-to-motion latent diffusion model within a unified architecture, modulating motion style through a lightweight adaptation module. It integrates an efficient relative positional encoding scheme and is trained on both stylized and non-stylized datasets, enabling strong generalization to unseen text-style combinations. Experiments show that FlexMoGen achieves the best balance between content fidelity and style reflection.

Mon 7 SeptComputer Vision and Pattern RecognitionGraphicsMachine Learning
The gist
It’s hard to make computer animations that not only follow a story or text but also look the way you want in terms of style, like how fast or expressive the movements are. The authors created FlexMoGen, a system that uses both written descriptions and example video clips to make animations that match the story and the style exactly. Unlike other methods, this system can mix different styles over time and doesn’t need style categories to work. It was trained to handle lots of different combinations and can create smooth, long animations that keep the meaning and the look the user wants.
Open → 2609.08032v1