Papers for

space robotics teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Visual place recognition benchmark for moon and mars like environments

VPR-Space: A Benchmark for Visual Place Recognition in Space Analog Domains

Abstract: Visual Place Recognition (VPR) is an important means for loop closure detection in visual Simultaneous Localization and Mapping (SLAM). While state-of-the-art VPR and SLAM approaches excel in urban and feature-rich natural environments, the vast and feature-poor environments of extraterrestrial surfaces like on the Moon or Mars pose severe challenges for existing approaches. This paper presents a novel benchmark, VPR-Space, to evaluate VPR capabilities on extraterrestrial surfaces. There are three contributions: (1) We collected sixteen VPR database-query datasets based on existing data from Space Analog Domains (SAD), terrestrial environments that resemble properties of the Moon or Mars. The collection includes a range of challenges regarding environment, viewpoint change, and illumination conditions. (2) To address the ill-posed nature of VPR, we propose a novel approach to generate the ground-truth information in VPR benchmarks. Instead of defining that a query and datbase image show the same place if and only if their camera poses are within fixed position and viewing direction thresholds, we propose to make the decision dependent on whether the match would be valuable in the downstream SLAM task. To avoid the overhead and restrictions of evaluating VPR in-the-loop within SLAM systems, we provide VPR ground-truth (GT) matrices based on the performance of an ensemble of state-of-the-art Relative Pose Estimators (RPE). Under this GT we require a VPR method to identify exactly those image pairs for which a subsequently applied RPE is expected to provide a valuable pose estimate in a SLAM context. (3) We evaluated nine state-of-the-art VPR approaches. The results show considerable room for improvement and indicate directions for future research. We provide a pre-release version of the dataset on github: $\texttt{https://github.com/rfechner/VPR-Space}$

Mon 26 OctRoboticsComputer Vision and Pattern Recognition
The gist
Recognizing places visually helps robots know where they are by comparing current camera views to past ones, which is especially challenging on the Moon or Mars due to few features. The paper presents a new set of test datasets based on Earth environments similar to these space surfaces. It introduces a better way to decide when two images show the same place, focusing on usefulness for robot navigation instead of just camera positions. The authors tested nine existing methods and found that better solutions are needed for these space-like conditions.
Open → 2610.35642v1

Open source lunar rover simulator models shadows for better navigation

MARE: An Open-Source Lunar Rover Simulator with Shadow Ground Truth for Perception and Autonomy

Abstract: Lunar surface exploration increasingly relies on autonomous rovers that must perceive and traverse unstructured terrain under extreme illumination conditions. Near the lunar poles, low sun elevations produce long, high-contrast shadows that challenge stereo vision, terrain segmentation, and localization. Developing perception and navigation algorithms for these conditions requires large amounts of sensor data with accurate ground truth, which field campaigns and analog facilities can only provide at high cost and with limited variety. This paper presents MARE (Modular Autonomy and Rendering Environment), an open-source simulation suite for lunar rover perception and autonomy built on Unreal Engine 5 and ROS 2. MARE consists of three integrated components. Terrain Studio generates cratered and rocky lunar Digital Elevation Maps (DEMs) to build simulation scenes. A dedicated Unreal Engine project hosts two physics-based rovers with plugins for stereo, lidar, event, and Single-Photon Avalanche Diode (SPAD) cameras, streaming time-stamped sensor data and pixel-accurate ground truth. Lastly, a Guidance, Navigation, and Control (GNC) stack provides web-based mission control. Validation shows a mean Intersection over Union (IoU) of 0.79 between predicted and rendered shadows at low sun elevations, and stereo depth analysis verifies decreased pixel coverage in shadowed regions relative to sunlit terrain.

Tue 20 OctRobotics
The gist
Rovers exploring the moon must navigate tricky shadows cast by low sun angles, which cause problems for cameras that help them see the ground. The authors created an open-source simulator called MARE that can mimic these challenging lunar conditions, including accurate shadows and sensor data. This tool helps test rover vision and movement software without sending robots to the moon or expensive test sites. It also includes mission controls and realistic rover models to improve testing of autonomous lunar driving.
Open → 2610.28465v1

Quadruped robots map and navigate rough lunar terrain autonomously

Terrain-Aware Autonomous Planetary Exploration for Exteroceptive-Proprioceptive Mapping with Quadruped Scouts

Abstract: Autonomous planetary exploration requires robots to navigate unknown, uneven terrain while assessing risk, traversability, and energetic cost. Quadruped scouts are well suited for this task because they can traverse irregular surfaces and gather mobility-relevant information during locomotion. This paper presents a terrain-aware exploration framework that combines exteroceptive and proprioceptive mapping for a quadruped robot in lunar-like environments. An onboard RGB-D camera builds robot-centered elevation maps, estimates geometric traversability, and derives navigation costs for autonomous planning. In parallel, proprioceptive measurements provide interaction-aware terrain cues that complement geometry-based assessment. Local maps are incrementally registered into a global multi-layer representation, which is used by an exploration module to select targets in unexplored regions of interest. The targets are reached by an autonomous navigation system that guides collision-aware motion using the available map and cost layers. Simulation results on NVIDIA Isaac Sim show autonomous exploration, map expansion, and spatial association between terrain geometry and robot-terrain interaction. Subsequent navigation using this information exhibits lower average Cost of Transport (CoT) than initial exploration.

Mon 28 SeptRobotics
The gist
Exploring unknown planetary surfaces can be tricky because robots have to walk over rough ground safely and efficiently. This paper presents a way for a four-legged robot to create detailed maps using cameras and its own movement sensors. These maps help the robot figure out where it can safely walk while spending less energy. The system combines both what the robot sees and feels to better understand the terrain. Testing in simulations showed the robot could explore and move around while using less energy than before.
Open → 2609.35493v1

Graph planning method guides space station multi-limbed robots safely

Graph-Based Simultaneous Path and Foothold Planning for Multi-Limbed Intra-Vehicular Robots in Space Stations

Abstract: Robot-aided operations in space stations are essential for reducing the workload of astronauts and improving the efficiency of on-orbit activities. Multi-limbed intra-vehicular robots (MLIVRs) equipped with grappling end-effectors have emerged as a promising solution, as they can securely grasp pre-existing interfaces, such as handrails and seat tracks, thereby enabling stable locomotion and forceful manipulation in microgravity environments. Since graspable locations on these interfaces are spatially limited and discretely distributed, motion planning for MLIVRs must be addressed jointly with foothold planning. This paper presents a simultaneous path and foothold planning framework based on graph theory for MLIVRs. The proposed method efficiently searches for feasible stance sequences for a multi-limbed robot while satisfying manipulability constraints. The effectiveness of the proposed framework is validated through simulations in a 3D model of the International Space Station (ISS) cabin, demonstrating its capability to generate feasible and efficient locomotion plans in realistic intra-vehicular environments.

Mon 28 SeptRobotics
The gist
Moving robots inside space stations is tricky because they must grab onto limited handrails and surfaces to hold on safely. The authors developed a new planning method that helps multi-limbed robots figure out where to place their limbs and how to move through the station together. They tested this method in simulations of the International Space Station to show it can create safe and efficient routes for the robots to travel and work in microgravity.
Open → 2609.35000v1

Lunar rover slip estimation improved by fusing expert models

Fleet-To-Lab: A Transfer Learning Framework For Lunar Rover Slippage Estimation Via Model Fusion

Abstract: Accurate wheel slip estimation is essential for autonomous lunar rover mobility and navigation. Machine Learning models trained on terrestrial data generalize poorly to lunar terrain, and real lunar datasets are scarce due to the limited number of missions and costly data acquisition. We present Fleet-to-Lab, a transfer learning framework that leverages proprioceptive data collected by previously deployed heterogeneous lunar rovers to mitigate the Earth-Moon domain gap in slip estimation for a future deployable unit. We fuse several heterogeneous expert models into a single architecture, using a modest dataset collected after the rover deployment. We propose AcoMerge, a new hybrid swarm-intelligence algorithm that performs model fusion by searching for an optimal combi- nation of expert parameters. Experiments conducted in a high- fidelity physics simulation show balanced accuracy and macro- F1 improvements compared to deep model fusion baselines. AcoMerge exhibits competitive performance with joint training on deep architectures, while achieving higher macro-F1 and balanced accuracy on a smaller model. Overall, our framework shows model fusion as a possible transfer learning alternative for slippage estimation in space robotic missions with limited data.

Tue 15 SeptRobotics
The gist
Estimating how much a lunar rover’s wheels slip is important for safe movement, but models trained on Earth don't work well on the Moon because the terrains are very different. The authors created a system called Fleet-to-Lab that uses data from previous lunar rovers to improve slip prediction for new rovers, even with limited new data. They combine multiple expert models into one using a special algorithm, AcoMerge, which smartly finds the best way to mix them. Their tests in a detailed simulation showed better and more balanced predictions compared to other methods. This approach may help future space missions deal with small datasets when estimating rover slippage.
Open → 2609.17187v1

Learned occupancy predictions improve robot mapping and navigation decisions

Rethinking Learned Occupancy in Autonomous Active Mapping with Observation-Gated Filtering

Abstract: Autonomous 3D active mapping requires a space robot to choose where to sense while building the geometry needed for navigation. Learned occupancy completion extends spatial context beyond the current field of view, but one predicted map often serves two planning roles: it scores expected surface gain and constrains collision-free motion. Unsupported occupancy can therefore distort both where the robot looks and where it believes it can travel. We study this coupled interface in a controlled closed-loop benchmark by holding the active-mapping system fixed and varying only its planner-facing occupancy across observation-only, learned, oracle-corrected, and ground-truth conditions. Improving occupancy accuracy does not monotonically improve closed-loop coverage: across 25 starts, planning with ground-truth occupancy reaches 70% of the learned baseline's final coverage 12.7 steps earlier on average, while increasing final coverage by only 0.031. Guided by this diagnosis, we introduce an observation-gated filter that retains completion in insufficiently observed regions and suppresses predictions only after repeated frustum exposure without nearby RGB-D support. The filter improves both targeted failure-prone starts without retraining or ground truth. These results motivate online revision of planner-facing geometry during autonomous intervals between communication windows. The current study assumes benchmark RGB-D observations and sufficiently accurate pose estimates; planetary sensing conditions and accumulated localization drift remain to be evaluated.

Tue 8 SeptRoboticsComputer Vision and Pattern Recognition
The gist
Robots mapping 3D environments must decide where to look next and how to move safely. Using learned predictions helps fill in parts of the map the robot hasn't seen yet, but relying too much on guesses can cause mistakes in both planning where to sense and where to travel. The authors tested different ways to provide the robot with occupancy maps and found that better map accuracy doesn't always mean better exploration. They created a filter that uses actual observations to decide when to trust predictions, improving mapping without extra training.
Open → 2609.09069v1