Papers for

3d computer vision developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Geodesic eccentricity helps detect 3D keypoints on objects

GEKey: Learning Geodesic Eccentric 3D Keypoints via Self-Supervision

Abstract: Point clouds represent 3D object geometry as sets of spatial coordinates. A fundamental task in their analysis is keypoint detection, i.e., identifying a sparse subset of points that captures the most salient features. While supervised methods rely on manual annotations, unsupervised approaches leverage intrinsic geometric properties to localize keypoints without human input. We introduce GEKey, a self-supervised framework that uses the geodesic eccentricity transform, an SE(3)-invariant geometric measure, to identify instance-specific salient points. These points serve as pseudo-labels to train a model that aligns its predictions with the object's intrinsic structure. GEKey is simple, efficient, and robust, preserving intra-class variation by balancing instance-specific and category-level structure. Extensive experiments on ShapeNetCoreV2, KeypointNet, CAPE, ITOP, and DeformingThings4D show state-of-the-art performance in both keypoint detection and alignment, with strong resilience to noise, downsampling, deformations, and real-world conditions. The code and pretrained models are available at https://github.com/Pierreoo/GEKey.

Thu 5 NovComputer Vision and Pattern Recognition
The gist
Detecting important points on 3D objects helps computers understand shapes. The authors created GEKey, a method that finds special points on objects without needing human labels. It uses a geometric property called geodesic eccentricity to find points that stand out for each object. Their method works well even when objects are noisy, incomplete, or change shape.
Open → 2611.07677v1

DINO features improved for partial 3D shape matching with self learning

Teaching DINOv3 About Partial 3D Geometry: A Self-Supervised Geometry-Aware Approach

Abstract: Partial shape matching is a crucial yet underexplored problem in 3D vision, with significant relevance to real-world scenarios where shapes are often only partially observed. Existing feature descriptors face difficulties in this setting, as traditional representations either struggle with the boundaries of partial shapes or heavily depend on the shape's spatial position. While existing approaches have employed DINO features for partial shape matching, these features are not inherently suited for handling partial observations. In this work, we propose a method to refine DINO features using LoRA-based self-supervised learning, enabling the generation of feature descriptors that are robust to partiality. Our features substantially improve performance on partial shape matching compared to traditional or vision foundation features. Additionally, when integrated into existing partial shape matching pipelines, we achieve state-of-the-art results on partial shape matching and left-right prediction benchmarks.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
Matching parts of 3D shapes is hard because often you only see bits of an object, and usual methods struggle to recognize these partial views. The paper shows how to teach a known image-based feature system called DINO to understand incomplete 3D shapes better through self-supervised learning. This improved DINO can create better shape descriptors that work well even when only part of the shape is visible. Their method beats older techniques on tasks like matching partial shapes and predicting left-right orientation.
Open → 2610.21802v1