Papers for

film and video production teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Diffusion model improves same person face replacement in photos

PicturePerfect: Diffusion-based Same-identity Facial Replacement

Abstract: With the growing success of diffusion models in computer vision, we explore their potential for same-identity facial replacement in photographs. Specifically, we propose a diffusion-based method, built on top of a pre-trained text-to-image model, that takes as input a portrait image of a person and a second reference image of the same individual, potentially captured under different conditions. The goal is to seamlessly replace the input face with the reference face, while keeping the background intact. Surprisingly, despite the clear real-world utility of this task, no recently published work has directly addressed face replacement in this specific setting. To support this goal, we construct a large dataset of image pairs depicting the same person under varying facial expressions and poses. Experimental results demonstrate that our approach produces more realistic and identity-consistent results than existing face reenactment models.

Thu 29 OctComputer Vision and Pattern Recognition
The gist
Replacing a person's face in a photo with another image of the same person is tricky, especially when the photos have different lighting or expressions. The authors developed a method that uses a special type of AI called a diffusion model to swap faces in pictures more naturally and realistically. They built a big dataset of photos showing the same person with different faces to help train and test their method. Their results look better and keep the person's identity more consistent than previous techniques.
Open → 2610.39344v1