Papers for

3d asset creators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Few-step 3d generation speeds geometry creation with better texture accuracy

Channel Match: Calibrating Shape Latents for Few-Step 3D Generation

Abstract: Recent native 3D generators achieve high-quality asset creation by modeling structured 3D latents with flow-based transformers, but their high-resolution generation remains computationally expensive due to costly iterative sampling. In this work, we introduce a few-step distillation framework for native 3D generation, enabled by continuous self-consistency training with a custom JVP FlashAttention kernel and an analytic velocity regression objective for sparse structured 3D latents. To stabilize joint optimization, we further introduce an adaptive loss weighting strategy that automatically balances them without manual tuning. Beyond acceleration, we reveal a previously overlooked failure mode of few-step native 3D generation: sampling-induced latent distribution drift preserves geometric correctness but disrupts downstream PBR texture synthesis, causing texture artifacts on geometrically valid assets. To address this issue, we propose Channel Match, a training-free adaptive per-channel latent calibration method that restores the latent distribution without modifying either generator. We validate our approach on TRELLIS.2 at the $1024^3$ resolution setting. Our two-step model achieves $4.5\times$ faster geometry sampling while maintaining geometry quality comparable to the many-step teacher, and Channel Match further improves rendering quality by recovering the latent interface between geometry and appearance generation.

Sun 11 OctComputer Vision and Pattern Recognition
The gist
Creating detailed 3D models usually takes many slow steps, making it hard to generate high-resolution shapes quickly. The authors present a way to speed up this process to just a few steps, keeping the shape quality high. They also found a new problem where faster methods cause texture errors even though the shapes are still correct, and they fix it by adjusting the internal features that control textures without retraining the model. Their improvements make 3D generation both faster and better for realistic looks.
Open → 2610.15321v1

High resolution image to 3D system recovers fine object details

HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolution

Abstract: Image-to-3D generation has become increasingly capable of producing objects that closely resemble the input image, and an outstanding challenge is to reproduce the depicted object itself, including the specific geometry that defines it. Inscriptions, brand marks, and repeated structures are frequently distorted or lost, despite being critical to object identity. We present Hi3D 3.0, an image-to-3D generation system targeting object-specific fidelity, with Twinkle3D as its geometry model for generating watertight triangle meshes at $2048^{3}$ resolution. Twinkle3D advances high-fidelity geometry generation along four dimensions. First, while O-Voxel/FaithC offers high representational precision, it often suffers from poor surface quality and non-watertight geometry. We address both issues while retaining its $2048^{3}$-level precision. Second, we scale diffusion generation to sequences of up to 300K geometric tokens through a redesigned DiT architecture and large-scale distributed training optimizations, reducing training time per step from approximately ten minutes to ten seconds. Third, subsequent refinement cannot fully compensate for errors introduced during initial generation; we therefore strengthen both global shape and local detail in the initial generation stage, and the resulting single-stage model surpasses prior two-stage pipelines with $512^{3}$ refinement. Finally, we introduce a fine-grained image-3D cross-modal interaction mechanism that strengthens correspondence between visual evidence and geometric tokens, improving the recovery of object-specific structures. We evaluate geometric fidelity using alignment metrics derived from silhouettes and normal fields. Hi3D 3.0 outperforms four commercial systems across all reported metrics, recovering 82.1% of inscribed characters at 98.2% precision, compared with 21.7% recall for the strongest competitor.

Thu 8 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Turning a flat picture into a detailed 3D model is tricky, especially capturing small details like logos or inscriptions. The authors improved a system called Hi3D 3.0 that creates very precise 3D objects from images, able to keep those tiny features clear and accurate. They made the system faster and better at matching parts of the picture to the 3D shape, leading to models that look more like the real objects. This helps make 3D shapes that keep important details others often miss.
Open → 2610.11685v1

Alignment method improves realism in 3D asset generation

OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization

Abstract: Despite recent advancements in 3D generation, models often struggle to produce assets with high visual fidelity. To bridge this gap, we propose OREO, an alignment framework that enhances the realism of 3D generators by leveraging rich 2D diffusion priors. Instead of relying on static datasets, OREO establishes a dynamic optimization loop that produces on-the-fly edited renderings as 2D pseudo-targets. At its core, we introduce Reinforced Editing, which utilizes a 2D model to refine rendered views of the 3D output, enhancing their overall visual fidelity while preserving the underlying geometry, viewpoint, and content. These refined views serve as high-quality supervision targets, enabling the 3D generator to learn from its own generated samples and progressively improve its visual quality. Experiments demonstrate that OREO effectively improves upon pre-trained baselines, producing 3D assets with enhanced visual realism.

Thu 24 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Creating realistic 3D objects on computers is challenging because many models produce visuals that don’t look quite right. The authors introduce a method named OREO that uses a loop where 3D objects are rendered into images and then improved using 2D image tools. These improved images guide the 3D model to make better-looking objects over time. This approach helps the 3D generator learn from its own mistakes and gradually create more lifelike visuals.
Open → 2609.29788v1

Selective generation of 3D object parts from user prompts

SAM3D-Part: Interactive Part Selection and Generation from 3D Objects

Abstract: Part-level control is essential for modern 3D asset creation, where objects are frequently edited, reused, animated, or fabricated through their individual components. In many such workflows, users need only several specific components rather than a complete object decomposition. However, existing 3D generation methods produce all parts regardless of user intent, while promptable 3D segmentation methods typically output partial surfaces instead of reusable complete meshes. In addition, image-conditioned part generators further struggle to preserve hidden geometry and accurate placement without directly conditioning on the source mesh. To address these problems, we present SAM3D-Part, a prompt-driven framework for selective part generation from input 3D object meshes. Given a source mesh and a part prompt, SAM3D-Part first encodes the source geometry into compact mesh features and aligns them with the rendered image, selective mask, and point-map observations via pixel-wise channel fusion. The fused representation conditions a feed-forward generative model to produce only the queried component as a completed mesh. To place the generated part back into the source coordinate frame, SAM3D-Part predicts dense per-voxel correspondences and estimates the part transformation from distributed spatial evidence rather than a single global pose code. For sequential multi-part queries, previously generated parts are stored in a part cache and reused as contextual constraints, reducing conflicts among independently requested components. Extensive experiments and ablations demonstrate that SAM3D-Part can significantly improve source alignment, reduce conditioning cost, and enable consistent selective part generation, achieving state-of-the-art. Code and weights will be available at https://github.com/Jiahao620/sam3d-part.

Mon 14 SeptComputer Vision and Pattern Recognition
The gist
Creating detailed 3D models often requires working with individual parts rather than whole objects. Existing tools either generate every part regardless of what users want or only provide partial shapes that aren’t usable on their own. The authors introduce SAM3D-Part, a new system that lets users pick specific parts of a 3D object by giving a prompt, then generates a full mesh of just that part correctly positioned. It also keeps track of created parts to avoid overlapping and helps creators work more efficiently with 3D models.
Open → 2609.15639v1