Papers for

3d computer vision engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

BlazeVGGT speeds up multi-view 3D reconstruction 13 times at 2000 frames

BlazeVGGT: 13x Faster VGGT at 2,000 Frames via Camera Token without Training

Abstract: Feed-forward visual geometry models, exemplified by VGGT, have demonstrated strong multi-view reconstruction capabilities through dense global attention. However, the resulting all-to-all cross-view computation scales quadratically with the number of input views, making long-sequence inference particularly expensive due to substantial frame-level redundancy among highly overlapping observations. We uncover a topology-first, geometry-later evolution in VGGT camera tokens: shallow-layer tokens reliably capture local view neighborhoods, whereas deeper-layer tokens progressively encode globally organized inter-view geometry. Motivated by this observation, we introduce BlazeVGGT, a training-free framework for structure-aware frame-level key--value sparsification. At each global-attention block, BlazeVGGT constructs a view-level similarity kernel from camera-token relations and employs greedy determinantal point process inference to select a compact set of mutually complementary views. The selected views constitute the key--value context, while all input frames are retained as queries. This asymmetric attention design preserves dense per-frame predictions while eliminating redundant cross-view computation, allowing our method to be directly integrated into pretrained VGGT as a plug-and-play module without parameter updates. Its advantages become increasingly pronounced with sequence length: at 2,000 frames, BlazeVGGT achieves approximately 13$\times$ faster inference than VGGT while reducing the Chamfer Distance from 0.41 to 0.32. Extensive experiments demonstrate a favorable accuracy--efficiency trade-off in point-cloud reconstruction and camera-pose estimation, compatibility with existing VGGT accelerators such as FastVGGT and LiteVGGT, and transferability to VGGT-based models including StreamVGGT and PAGE-4D. Codes are publicly available at https://github.com/MagiciannnY/BlazeVGGT.git.

Wed 21 OctComputer Vision and Pattern Recognition
The gist
Processing many frames to reconstruct 3D scenes can be very slow because every frame is compared with all others. The authors noticed that early steps in the process capture local relationships, while later steps represent global structure. Using this insight, they created BlazeVGGT, which picks a smaller set of key frames for comparison without additional training. This method keeps all frames for detailed predictions but avoids redundant calculations, making the process much faster and even more accurate over long sequences.
Open → 2610.29454v1

Sample adaptive token routing improves 3D model test time accuracy

SATOR: Backpropagation-Free 3D Test-Time Adaptation via Sample-Adaptive Token Routing

Abstract: Test-time adaptation (TTA) mitigates the performance degradation of source-pretrained models on unlabeled test data under distribution shifts. Recent backpropagation-free token-purging methods address 3D point cloud distribution shifts by filtering unreliable tokens. However, their reliance on predefined purge-size candidates requires multiple forward passes per sample and increases inference cost. We propose SATOR (Sample-Adaptive TOken Routing), a source-free and backpropagation-free 3D TTA framework that eliminates this search by deriving both the partitioning threshold and routing decision directly from each sample. SATOR computes token abnormality scores from complementary attention and geometric relation graphs. It then derives a sample-specific partition into retained and pruned tokens via Otsu-based separability, without evaluating candidate sizes. Keep-ratio-calibrated routing then selects the pruned prediction only when its entropy, penalized by the keep ratio, is lower than that of the original prediction. Experiments on ModelNet40-C, ScanObjectNN-C, and ShapeNet-C demonstrate that SATOR achieves state-of-the-art accuracy on three 3D corruption benchmarks.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
3D models trained on one set of data can perform worse when tested on new, different data. The authors created a method called SATOR that helps these models adapt without needing extra training steps during testing. SATOR smartly decides which parts of the 3D input to keep or ignore based on each sample’s unique data. This approach makes the model more accurate when handling corrupted or changed 3D shapes.
Open → 2610.21367v1

PointLearner improves 3D point cloud perception with brain-inspired focus and context

Point-Focused Attention Meets Context-Scan State Space: Robust Biological Visual Perception for Point Cloud Representation

Abstract: Synergistically capturing intricate local structures and global contextual dependencies has become a critical challenge in point cloud representation learning. To address this, we introduce PointLearner, a point cloud representation learning network that closely aligns with biological vision which employs an active, foveation-inspired processing strategy, thus enabling local geometric modeling and long-range dependency interactions simultaneously. Specifically, we first design a point-focused attention, which simulates foveal vision at the visual focus through a competitive normalized attention mechanism between local neighbors and spatially downsampled features. The spatially downsampled features are extracted by a pooling method based on learnable inducing points, which can flexibly adapt to the non-uniform distribution of point clouds as the number of inducing points is controlled and they interact directly with point clouds. Second, we propose a context-scan state space that mimics eye's saccade inference, which infers the overall semantic structure and spatial content in the scene through a scan path guided by the Hilbert curve for the bidirectional S6. With this focus-then-context biomimetic design, PointLearner demonstrates remarkable robustness and achieves state-of-the-art performance across multiple point cloud tasks.

Thu 8 OctComputer Vision and Pattern Recognition
The gist
Representing 3D point clouds accurately is hard because you need to understand both detailed local shapes and the overall scene. The paper introduces PointLearner, which mimics how biological vision works by focusing sharply on small parts like the eye's fovea while also scanning the broader environment like eye movements. This approach helps the system better capture fine details and long-range relationships between points, making it more robust and effective. As a result, PointLearner performs very well on tasks involving 3D data.
Open → 2610.11342v1

Geometry-aware prompting improves 3D model adaptation with fewer parameters

GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model

Abstract: Pre-trained 3D vision models have substantially advanced point cloud analysis, yet adapting them to downstream tasks via full fine-tuning is computationally expensive and storage-intensive. Parameter-Efficient Fine-Tuning (PEFT) offers a promising alternative by reducing both adaptation cost and storage burden. However, existing prompting-based approaches ignore the intrinsic geometric structures of point clouds, thereby limiting their adaptation capability. This limitation stems from their inability to encode both fine-grained geometric cues and coarse-grained structural semantics, as well as failing to propagate such information effectively through the model hierarchy. To address these challenges, we propose GAPrompt++, a multi-granular geometry-aware prompting method that provides richer geometric guidance for efficient 3D task adaptation. Specifically, we introduce a Point Shift Prompter that extracts multi-granular geometric features across different scales, enabling instance-specific geometric adjustments during adaptation. Next, a Keypoint Prompter adaptively generates point-level prompts to highlight local geometric saliency and fine-grained structural details. Furthermore, a Prompt Propagation mechanism injects these multi-granular geometric cues throughout the feature extraction hierarchy, strengthening the ability to capture essential geometric characteristics. Extensive experiments show that GAPrompt++ achieves state-of-the-art performance among prompting-based PEFT methods and even surpasses full fine-tuning across diverse benchmarks, while requiring less than 2\% trainable parameters. In addition, to address the saturation of existing evaluation datasets, we construct two more challenging benchmarks derived from 3D Gaussian Splatting and Multi-View Stereo reconstruction, offering diverse and realistic point cloud scenarios to promote future research.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Adapting large 3D vision models to new tasks usually needs a lot of computing power and storage. The authors propose GAPrompt++, a method that adds special geometric clues at different detail levels to help models learn faster and use fewer adjustments. Their approach carefully highlights important shapes and points, spreading this information through the model to improve understanding of 3D scenes. Tests show this method works better than many others, even beating full retraining, while needing less than 2% of the parameters to be changed. They also created harder test sets for point cloud models to push future research further.
Open → 2609.19716v1