Papers for

game asset creators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

HilbertGen 3D improves 3D model generation with global shape awareness

HilbertGen-3D:Hilbert--Multifractal Conditioning for Topology-Aware 3D Generation

Abstract: High-fidelity 3D generative modeling underpins game asset creation, medical imaging, and VR/AR environmental design, where geometric structure directly influences perception and decision-making. Diffusion models represent a powerful paradigm for point cloud generation. However, existing approaches rely heavily on local voxel or patch features and often miss global structural organization, and much less work has studied how global conditioning can be used to improve generation quality. In this paper, we introduce HilbertGen-3D, a novel topology-aware conditional diffusion framework based on Hilbert-Multifractal Conditioning (HMC). HMC computes multi-scale voxel measures, serializes them via a 3D Hilbert curve to expose structured spatial dependencies, and estimates the generalized fractal dimensions from scale-dependent partition functions. We encode these signals as global embeddings and multi-scale tokens, and inject them into a diffusion denoiser through an efficient bottleneck fusion module. Across the Chair, Airplane, and Car categories of ShapeNet, our two conditioning variants reduce the absolute deviation of 1-Nearest Neighbor Accuracy (1-NNA) from 50% by up to 8.90 percentage points and increase coverage by up to 5.88 percentage points relative to TopoDiT-3D. This shows that combining local density cues with global Hilbert-multifractal structure provides a simple and effective recipe for high-fidelity and diverse 3D generation.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
Creating realistic 3D shapes is important for games, medical images, and virtual worlds. Current methods mostly look at small parts of the shape and miss the big picture. The authors developed HilbertGen-3D, which uses a special math tool to understand and include the overall shape structure when making new 3D models. This helps produce more accurate and varied 3D objects like chairs, airplanes, and cars.
Open → 2610.22720v1

Flow3D-OPD improves 3D mesh generation with teacher-student training

Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer

Abstract: Recent image-to-3D generation models built on flow-matching diffusion Transformers (DiT) can produce high-fidelity meshes, yet their post-training strategy remains largely unexplored. There exist several critical bottlenecks in reinforcement learning: the inherent difficulty of defining comprehensive rewards for 3D geometric quality, and the gradient interference that arises when jointly optimizing heterogeneous objectives. Inspired by the practicability of on-policy distillation (OPD) in large language models and image generation, we propose \textbf{Flow3D-OPD}, a two-stage post-training framework that introduces multi-teacher distillation into 3D geometry generation. In the first stage, we utilize the semi-policy to enhance the foundational capability of the pretrained model and then design an agentic verifier for 3D geometric quality evaluation. Based on the verifier, we could cultivate domain-specialized teacher models via direct preference optimization (DPO). In the second stage, we consolidate heterogeneous expertise into a unified student model through on-policy distillation with hard task-routing sampling and gradient accumulation, which could mitigate the gradient interference in joint optimization. Without relying on elaborate modifications, our straightforward yet effective design achieves consistent improvements across all geometric quality dimensions and surpasses all teacher models in the average metric. Extensive experiments demonstrate that our approach provides an effective paradigm for reinforcement learning in 3D generation.

Mon 7 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating detailed 3D shapes from images is hard because it's difficult to measure quality and optimize for it. The authors designed a two-step training process that uses multiple expert models to teach a single student model how to create better 3D shapes. First, they improve the base model and create experts that specialize in certain quality aspects. Then, they combine those experts into one model that learns from them all without conflicts. This approach leads to consistently better 3D shape results than previous models.
Open → 2609.07137v1