Robots map and inspect underground mineral deposits for mining

Towards Spatial Perception for Heterogeneous Robot Collaboration in Subterranean Mining Environments

Robotics

Summary

Exploring deep abandoned mines is tough because no single robot can both explore long tunnels and analyze minerals well. The authors describe two robots working together: one maps the cave and finds minerals using an AI that understands language, while the other inspects the minerals more closely using the map and data from the first robot. They tested this approach underground, showing it works even in difficult conditions like poor lighting and dust.

What this means in practice

  • For mining operation teams: Coordinate multiple robots to efficiently explore and inspect underground mineral sites with limited sensing capabilities.
  • For search and rescue teams: Use heterogeneous robots to collaboratively map and inspect complex subterranean environments where individual robots cannot perform all tasks alone.

Authors

Mario Alberto Valdes Saucedo, Akash Patel, Christoforos Kanellakis, George Nikolakopoulos

Abstract

The autonomous extraction of deep mineral deposits in abandoned underground mines is fundamentally a multi-agent integration problem. No single platform simultaneously offers the mobility to traverse kilometers of degraded drifts and the sensing payload required to characterize an ore body. This article presents the onboard perception pipeline that bridges two heterogeneous agents within the PERSEPHONE autonomous mining mission. Which consist of a lightweight Explorer robot that maps an unknown mine and generates a 3D scene graph of inspection targets, by running a zero-shot, vision-language semantic segmentation stack that detects mineral deposits directly from natural-language prompts. The map and the graph are then handed to a second Inspector robot, which carries an advanced sensing payload and uses them to plan close-range inspection viewpoints. We detail the complete pipeline, with emphasis on the geometric abstraction that turns raw detections into actionable inspection targets, spanning per-view bounding-box generation, cross-view box merging, plane fitting, and polygon extraction, and we report an extensive field validation in a subterranean test facility and in an active magnesite mine, covering both iron-vein and magnesite mineralization under realistic, perceptually degraded conditions.