Papers for

augmented reality creators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Model articulation of 3D objects from limited sparse views

FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations

Abstract: Modeling articulated objects from sparse monocular views is challenging because each observation reveals only partial geometry and motion evidence. Most feed-forward methods infer articulation from a single observation and therefore rely heavily on learned category-level shape priors. We present FAMOS, a feed-forward model that predicts movable-part segmentation and joint parameters from a sparse, unordered set of partial point clouds. Our model jointly reasons over multiple observations and naturally supports a variable number of inputs, including a single view. To aggregate articulation cues across observations, we introduce a Multi-state Articulation Transformer with alternating state-wise and global attention. We further propose an observed articulation span objective that supervises the motion range each part exhibits across the input observations, encouraging the model to leverage the full observation set. To overcome the limited scale and diversity of existing datasets, we introduce a procedural data generator that synthesizes self-annotated assets during training. Experiments on PartNet-Mobility, ACD, and ArtiCraft-10K demonstrate consistent improvements over both feed-forward and optimization-based baselines. Project page: https://kevinqu7.github.io/famos

Thu 17 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceRobotics
The gist
Figuring out how parts of an object move based on just a few pictures is hard because each image only shows a small piece of the story. The authors created FAMOS, a method that looks at several partial views together to better understand how parts of objects can move. They use a special kind of neural network called a Multi-state Articulation Transformer to combine information across images. Their approach also uses a new training trick to learn the full range of motion from available views. Tests show that FAMOS works better than previous methods.
Open 2609.20817v1