Papers for

3d model developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Flow matching method improves 3d mesh generation quality

Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization

Abstract: Flow matching is central to 3D generation, yet in practice its reinforcement learning (RL) methods are largely adapted from 2D visual generation. Representative DPO-, GRPO-, and NFT-style objectives, when applied to negative trajectories, mainly steer predicted velocities away from the corresponding directions without explicitly specifying a target velocity field toward preferred samples. In 3D generation, constrained by pretrained model capabilities, rollout diversity, and reward-distribution complexity, directly applying these RL methods yields limited gains in geometric quality. We introduce a forward-process RL method \textbf{Dynamic Homing Optimization (DHO)}, which reformulates negative-trajectory optimization as positive-sample attraction-guided dynamic homing. Specifically, Minimum-Cost Attractive Matching (MAM) assigns each negative sample a distinct positive target, and Time-Aware Dynamic Correction (TDC) then redirects its trajectory toward the target using a remaining-time-aware corrective velocity. Building on asynchronous online DHO, we develop \textbf{Flow3D-Pro}, an image-to-3D geometry generation framework. Experiments show that DHO outperforms representative DPO-, GRPO-, and NFT-style objectives in 3D generation, while Flow3D-Pro produces higher-quality 3D geometry than existing mesh generation methods.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Generating 3D shapes like meshes often relies on techniques developed for 2D images, which may not work well for complex 3D data. The authors propose a new reinforcement learning approach called Dynamic Homing Optimization that directs the process toward better 3D shapes by pairing each less-desired sample with a specific better target and guiding it dynamically. This method helps create higher-quality 3D meshes compared to previous strategies. They demonstrate their approach within a system called Flow3D-Pro that produces better 3D geometry than existing mesh generation tools.
Open → 2610.01233v1

Neural operator improves matching between partial and full 3D shapes

NHO: A Neural Hamiltonian Operator for Anchor-based Region Localization and Dense Correspondance

Abstract: Non-rigid partial-to-full shape correspondence from sparse anchors requires identifying the corresponding region on the full surface and recovering dense correspondences between the partial shape and that region. We present NHO, which combines sparse anchors with the intrinsic geometry of the partial shape to learn a neural Hamiltonian operator whose localized eigenspace encodes both the region support and intrinsic coordinates for dense correspondence. NHO parameterizes the Hamiltonian potential as an intrinsic neural field and optimizes it using anchor evidence together with spectral and geometric constraints. To resolve the spatial ambiguity left by sparse anchors, we introduce reciprocal refinement between operator estimation and correspondence recovery. At each round, the current eigenspace provides spectral coordinates and restricts matching to its induced support, while geometrically reliable correspondences provide additional evidence for updating the potential. After refinement, aggregated eigenfunction energy yields the final localization, and the recovered map initializes dense correspondence refinement. Experiments demonstrate competitive accuracy on both tasks and robustness to uniform scaling and rotation.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Matching incomplete 3D shapes to their full versions is challenging because only a few matching points are known, and the rest must be figured out. The authors present a method called NHO that uses math-inspired tools combined with neural networks to find corresponding regions and detailed matches on the shapes. It uses an iterative process where guesses about the shape's matching regions and dense correspondences improve each other, making the final matches more accurate. Their tests show this method works well even if the shapes are scaled or rotated.
Open → 2609.37048v1

Metric measures how articulated objects move and connect accurately

ArticulateArena: A Metric for Articulated Kinematics

Abstract: Modern methods reconstruct or generate simulation-ready articulated objects, predicting not only their geometry but also how their parts are connected and allowed to move. Evaluating the geometry is straightforward, but evaluating the predicted articulation is not, because articulation specifies a motion rather than a shape, and there is no agreed distance between two motions. More specifically, existing protocols score joint type, axis direction, origin, and motion limits separately, although these parameters jointly describe a single physical motion, and the same motion can be written as different parameter values. As a result, a joint can score maximally wrong against an equivalent encoding of itself, and several component errors are ill-conditioned or undefined exactly where predictions become accurate. We propose ArticulateArena, a representation-invariant counterpart of Chamfer distance for articulation that compares the motions one-DOF joints induce rather than the parameters that encode them. It represents each joint by the unordered pair of its Lie-algebra endpoint twists, and we prove that the resulting quotient distance is a metric. It unifies fixed, revolute, prismatic, and helical joints, brings continuous joints into the same score through a compactification, and reads as the RMS motion of the moving part in meters when weighted by its mass distribution. A motion-aware tree edit distance lifts the metric to full kinematic trees, pricing structural errors such as spurious or missing joints in the same motion units as joint errors, and for a fixed inner product it remains a metric on trees up to relabeling. Alongside the metric we release ArticulateArena-20K, a new suite of 19,977 articulated objects with verified kinematics, and we re-evaluate published reconstruction methods on it under the new metric. Project page: https://heyumeng.com/ArticulateArena-web/

Sun 27 SeptRoboticsComputer Vision and Pattern Recognition
The gist
It's hard to compare moving parts of objects because their motion can be described in many ways. The authors created a new way to measure how parts move together that doesn’t depend on how you describe them. This method measures the actual motion caused by joints rather than just the numbers that describe the joint. They also made a big collection of objects with known movements to test their method and found existing ways to evaluate joint motions less accurate.
Open → 2609.33931v1

Backdoor attacks in 3D point cloud reconstruction get more precise control

Information Blackhole: Exploring Backdoor Mechanism in 3D Point Cloud Reconstruction

Abstract: Point cloud autoencoders are fundamental components for 3D world representation and support many safety-critical downstream applications. Existing studies have extensively investigated backdoor attacks on point cloud classification, whereas backdoor attacks against point cloud autoencoders remain largely unexplored. However, their backdoor behaviors differ substantially due to the intrinsic structural gap between discriminative and generative models. Specifically, a classifier is a discriminative model that separately fits the marginal distributions of benign and malicious data. In contrast, the generative nature of an autoencoder entangles the two within a unified latent distribution, leading to information crosstalk and reduced attack controllability. In this setting, residual source geometric information in malicious data may leak into the clean inference branch, causing the reconstruction to collapse toward the source data. We then propose the Information Blackhole principle, which introduces Gaussian distribution constraints to disentangle latent representations and block interfering information. Building on this principle, we further propose Adaptive Gaussian Matching (AGM), which explicitly regularizes the latent distribution of poisoned samples. By suppressing the propagation of source geometric information from poisoned features to the attacker-specified reconstruction target, AGM improves attack controllability. Extensive quantitative and qualitative experiments on ModelNet and ShapeNetPart demonstrate that the proposed framework improves the attack performance of several standard triggers and reveals the unique operating mechanisms of backdoor attacks against point cloud autoencoders.

Sun 27 SeptCryptography and Security
The gist
3D point cloud autoencoders help computers understand shapes in 3D, which is important for safe applications. The paper shows that attackers can hide backdoors in these autoencoders, but because these models generate data differently than classifiers, attacks behave differently. The authors introduce a method called Adaptive Gaussian Matching to better control how these hidden backdoors work, stopping unwanted information from leaking and making the attack’s effect more predictable. They tested this on common 3D shape datasets and showed their approach works better than previous attempts.
Open → 2609.33569v1

Flow3D-OPD improves 3D mesh generation with teacher-student training

Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer

Abstract: Recent image-to-3D generation models built on flow-matching diffusion Transformers (DiT) can produce high-fidelity meshes, yet their post-training strategy remains largely unexplored. There exist several critical bottlenecks in reinforcement learning: the inherent difficulty of defining comprehensive rewards for 3D geometric quality, and the gradient interference that arises when jointly optimizing heterogeneous objectives. Inspired by the practicability of on-policy distillation (OPD) in large language models and image generation, we propose \textbf{Flow3D-OPD}, a two-stage post-training framework that introduces multi-teacher distillation into 3D geometry generation. In the first stage, we utilize the semi-policy to enhance the foundational capability of the pretrained model and then design an agentic verifier for 3D geometric quality evaluation. Based on the verifier, we could cultivate domain-specialized teacher models via direct preference optimization (DPO). In the second stage, we consolidate heterogeneous expertise into a unified student model through on-policy distillation with hard task-routing sampling and gradient accumulation, which could mitigate the gradient interference in joint optimization. Without relying on elaborate modifications, our straightforward yet effective design achieves consistent improvements across all geometric quality dimensions and surpasses all teacher models in the average metric. Extensive experiments demonstrate that our approach provides an effective paradigm for reinforcement learning in 3D generation.

Mon 7 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating detailed 3D shapes from images is hard because it's difficult to measure quality and optimize for it. The authors designed a two-step training process that uses multiple expert models to teach a single student model how to create better 3D shapes. First, they improve the base model and create experts that specialize in certain quality aspects. Then, they combine those experts into one model that learns from them all without conflicts. This approach leads to consistently better 3D shape results than previous models.
Open → 2609.07137v1