Model adds 3D human figures into graphic designs for better visuals
Human-aware Design Generation: Adding 3D Humans into Graphic Designs
Graphics
Summary
Graphic designs often include pictures of people arranged carefully to attract attention and create feelings. The authors studied how to automatically add 3D human images into existing graphic designs in a way that fits well with the other design elements. They created a model that predicts the human pose, size, and position in 3D and 2D to complete the design harmoniously. Their system performs better than previous methods at placing humans naturally in these designs. This work is the first to combine 3D human modeling with 2D graphic design generation.
What this means in practice
- •For graphic design teams: Automatically insert realistic 3D human figures into partial designs to create balanced and engaging final visuals.
- •For game developers: Enhance in-game graphic user interfaces by adding harmonized 3D human images for improved player engagement.
Authors
Zijin Hou, Ying Cao
Abstract
Graphic designs nowadays predominantly contain human images, where people are posed and framed in a delicate way to guide viewers' visual exploration and evoke desired feelings. Despite recent progress in automatic graphic design generation, there has been no work on investigating the role of the human representations in design creation. In this paper, we seek to emphasize the importance of visual human representations in graphic design generation, by studying a novel task, dubbed as design-conditioned 3D human adding. To solve this task, we propose a model that adds 3D human representations into an existing partial design, by predicting their 3D poses, their 2D composition in the image containing them, as well as the spatial arrangement of the image in the input design, to generate a complete design. Our experiments show that our model outperforms baselines by predicting the 3D human poses, 2D framing and human image layout that better harmonize with the other existing design elements, and generating higher-quality holistic designs. Our work is the first to explore connections between 3D human generation and 2D graphic design generation, which would inspire future research in leveraging 3D information to build more powerful generative models for graphic designs in the 2D domain. The code is available at https://github.com/GreyNails/Human-aware-Design-Generation-Adding-3D-Humans-into-Graphic-Designs.