Papers for

robotics perception engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

SplashSplat reconstructs splashing liquids from multi-view videos

SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos

Abstract: A splash lives for a fraction of a second: sheets tear into ligaments and droplets, appearance is view-dependent and nearly textureless, and little persists long enough to track. Reconstruction research has consequently focused on smoke, synthetic liquids, or gently deforming surfaces. To our knowledge, no synchronized multi-view dataset of splashing liquids exists. We therefore introduce a benchmark of 20 real scenes, from coherent streams to violent splashes, captured by seven synchronized, calibrated 4K cameras at 60 fps, with manually refined per-view liquid and container masks and fixed evaluation splits. We further present SplashSplat, built on a single principle: impose physical structure only where the observations can constrain it. Per-frame liquid SDFs fused from the masks provide the geometry, level-set transport between consecutive SDFs yields a coarse velocity field, and Lagrangian carriers advected along this flow, corrected against each new observation and reseeded where coverage is lost, decode local Gaussians for differentiable rendering. SplashSplat outperforms state-of-the-art dynamic Gaussian splatting methods on our real captures and on a synthetic benchmark, with physically more plausible motion and a lower training cost. The same representation supports temporal interpolation and style transfer without re-optimization.

Thu 17 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Reconstructing splashing liquids is hard because they change shape very fast and look different from every angle. The authors created a new set of videos showing real splashes from seven cameras to help with this problem. They also made SplashSplat, a method that builds 3D liquid shapes and motions only where the video data supports it. This method produces smoother liquid movement and better results than previous techniques. It can even create smooth transitions between moments and apply new visual styles without starting over.
Open 2609.20818v1

Open vocabulary 3D object detection works with promptable segmentation

Open-vocabulary 3D object detection with promptable segmentation

Abstract: Three-dimensional object detection for autonomous driving is dominated by detectors trained on large corpora of human-annotated 3D boxes. Such a detector learns a fixed category list, and everything outside it is invisible. This paper asks whether the task can be solved training-free and open-vocabulary. A promptable segmentation model (SAM3), queried with class names as text prompts, supplies instance masks in the vehicle's six surround-view cameras, and the masks are turned into metric 3D boxes using the geometry of the scene. The core is a controlled three-stage comparison on nuScenes in which 2D detection is held fixed and only the source of 3D geometry changes. Geometry predicted from images alone reaches 0.183 mean average precision (mAP) under the official protocol; fitting boxes from raw LiDAR points inside the same masks with training-free rules reaches 0.298 mAP / 0.348 nuScenes detection score (NDS) at zero labeling cost; borrowing supervised box geometry at inference time lifts the same detections to 0.413 mAP / 0.555 NDS, which locates the pipeline's largest deficit in measurement precision rather than 2D detection, while class confusion and confidence calibration survive that substitution. Reversing the direction, a three-state camera-witness rule built from the same masks improves a supervised LiDAR-only detector from 0.596 to 0.630 mAP, roughly half the gain of fully supervised camera fusion, with no training. A coverage analysis shows that SAM3 finds 84% of in-range objects with a correctly named mask; the classes that fail in the official metric are misnamed or geometrically unforgiving, not unseen.

Wed 16 SeptComputer Vision and Pattern Recognition
The gist
3D object detection usually needs lots of labeled training data for a fixed set of object types, making unknown objects invisible to the system. The authors show that by using a segmentation model that can be prompted with text names of any class, they can detect objects in 3D from camera views without needing to train on 3D boxes. They turn 2D object masks into 3D boxes using different geometry sources, including image-based depth, LiDAR points without training, or supervised box fitting. Their approach finds most objects in view and can also improve traditional LiDAR-only detectors without extra training.
Open 2609.19358v1