Papers for

3d software developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Point cloud models recover performance from unseen rotations without gradients

Recovering Black-Box Point Cloud Models from Pose Shifts via Derivative-Free Optimization

Abstract: Point cloud models are increasingly deployed through score-only black-box interfaces. Under this access model, test-time rotations outside the training distribution can substantially degrade performance. Although existing mitigations such as equivariant retraining and gradient-based adaptation are effective, they are infeasible without access to model weights or gradients. To address this limitation, we propose CanDO, a test-time canonicalization method that recovers lost performance using only forward queries. Specifically, CanDO searches for an input transformation that maximizes model confidence and uses derivative-free optimization to perform this search without gradients. We further identify three conditions for successful recovery: a training augmentation gap, an accuracy-aligned confidence surrogate, and global search over a multi-modal objective. Across multiple architectures and benchmarks, CanDO recovers 76% of the oracle gap under azimuthal misorientation and 51% under arbitrary SO(3) rotations for object part segmentation. These results show that frozen score-only point cloud models can recover from rotation-induced distribution shifts through post-deployment canonicalization alone.

Mon 26 OctComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Point cloud models can struggle when objects are rotated in ways they weren't trained on, making them less accurate. The authors introduce CanDO, a method that fixes this by rotating the input again to find the version the model feels most confident about. This is done without needing to look inside the model or use its gradients. By searching carefully, CanDO can restore most of the lost accuracy caused by unfamiliar rotations after the model is deployed.
Open → 2610.34850v1

Pumpire benchmark measures 3D model accuracy in real-world scenes

Pumpire: Unified Benchmark for Metric Distance Estimation

Abstract: We present Pumpire, a unified benchmark for evaluating metric point-pair distance estimation capability of both image- and video-level 3D foundation models, with or without depth priors. In contrast to previous approaches that normally evaluate depth and camera intrinsics separately or evaluate point-clouds with geometric similarity metrics, which cannot directly reflect models' point-to-point distance estimation capability, Pumpire directly assesses point-to-point distances from the reconstructed geometry. To this end, we collect a large-scale and diverse dataset (pumpire-6k) comprising 100 real-world scenes, each annotated with physically measured point-pair distances and containing 64 frames, for a total of 6,400 frames. Building on this dataset, we establish a holistic evaluation protocol that covers both image- and video-level 3D foundation models and enables direct assessment of point-pair distance errors and cross-setting comparison. We conduct extensive experiments across 29 baseline configurations of representative 3D foundation models and provide a comprehensive analysis of the results. By offering this benchmark, we target the more fundamental ability to perceive and estimate physical scale in the reconstructed 3D space, which prior evaluation protocols have largely overlooked. The project page can be found at https://pumpire.github.io/

Thu 8 OctComputer Vision and Pattern Recognition
The gist
It can be hard for 3D models to tell exactly how far apart things are in a scene. The authors created Pumpire, a new way to test how well models estimate real-world distances between points in 3D images and videos. They gathered a big set of real scenes with known distances to check these models directly on how well they guess space and scale. This helps find out which models are better at understanding size and distance in the real world.
Open → 2610.12423v1

CreativeFlow boosts creative variety in 3D asset generation

CreativeFlow: A One-to-Many Analogical Relation Transfer Method for 3D Asset Generation

Abstract: Inspired by cognitive science, we present CREATIVEFLOW, an analogical generation framework that explicitly models analogical divergent thinking to mitigate creative homogenization in text-to-3D pipelines. Our method derives a series of meaningful yet relationally similar source-target asset pairs, each featuring distinct geometric configurations. Expert evaluations demonstrate that our framework substantially enhances creative novelty and visual fascination. This workflow and its resulting assets establish a foundational dataset and benchmark for future relation-aware 3D model training.

Sun 4 OctArtificial IntelligenceGraphics
The gist
Creating 3D objects from text often results in similar-looking models, limiting creativity. The authors introduce CreativeFlow, a method inspired by how people think analogically to produce various related but distinct 3D designs from the same text. Their approach pairs source and target assets that look connected but are geometrically unique. Experts found that CreativeFlow produces more novel and visually interesting 3D models. This work also provides a new dataset and benchmark to help train future 3D model creation systems.
Open → 2610.05167v1