Papers for

space mission developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AstroPIE-53 reveals challenges for astronaut pose detection in space

AstroPIE-53: Towards Understanding Failure Modes of Human Pose Estimation in Space

Abstract: Reliable monitoring of astronauts is essential for safety, situational awareness, and autonomous assistance in space missions. While modern computer vision enables accurate human detection and pose estimation on Earth, its robustness in space environments remains largely unquantified due to limited data availability. We present AstroPIE-53, a pilot dataset of 53 annotated astronaut videos collected from publicly available mission footage. To respect copyright restrictions, we release video identifiers, reconstruction scripts, and dense annotations rather than raw videos. The dataset includes bounding boxes, challenge classes, and human-annotated pose failure tags. We benchmark state-of-the-art person detection and pose estimation models under realistic zero-shot deployment conditions and perform the first systematic failure analysis for astronaut monitoring. Our results reveal substantial performance degradation caused by occlusions, unusual body orientations, low contrast, and microgravity motion patterns.

Sun 15 NovComputer Vision and Pattern Recognition
The gist
It is important to watch astronauts carefully to keep them safe during space missions. However, current computer vision tools that work well on Earth face many problems when used in space. The authors created a special dataset called AstroPIE-53 using publicly available videos of astronauts, helping study when and why these tools fail. They found that issues like unusual body positions, low lighting, and floating movements in microgravity cause these tools to perform poorly. This work helps identify what needs fixing for better astronaut monitoring in future missions.
Open → 2611.20207v1

Lunar robot swarms keep warm by moving like penguins at night

Emergent Cooperative Thermoregulation in Lunar Swarm Robotics

Abstract: Swarms of small robots are an attractive way to survey lunar caves and lava tubes. Missions such as NASA's CADRE will fly cooperating rovers for distributed mapping, but only in daylight. The 354 h lunar night drops the surface towards 95 K, and the radioisotope heaters that let single rovers survive it cannot be supplied at swarm scale. In this study we investigate whether a swarm can instead use its own members as thermal shielding. We train one policy, shared by all twenty robots, by reinforcement learning with an evolution-strategies estimator. The policy receives a single reward, once, at the end of the night: the mean temperature of the five coldest robots. Nothing in that reward refers to position, spacing, exposure or motion. Two behaviors nonetheless emerge. The swarm aggregates, and robots circulate between the sheltered core and the exposed rim, the same pair of behaviors with which emperor penguins survive the Antarctic winter. We measure the survival threshold, the smallest stored energy per robot at which every robot is still alive at sunrise. Across ten runs it is 155.6 +/- 1.3 pcm-h, where one pcm-h is 7.2 kJ of stored heat. That is 37% below a motionless huddle and within 13% of a physics-based lower bound, and at a budget where the motionless huddle loses six robots, every robot survives. The behavior needs no shared spatial reference and no robot-robot contact, and transfers from twenty robots to forty without retraining.

Thu 22 OctRoboticsMultiagent Systems
The gist
Lunar nights are extremely cold, making it hard for small robots to survive without heavy heaters. The authors show that a group of robots can keep warm by huddling together and taking turns moving from the cold outside to the warm center, just like emperor penguins do. This behavior emerged naturally when the robots were trained with reinforcement learning to maximize the coldest robots' temperature. Their approach helps every robot survive with less stored heat than other strategies, and it works even when the group size doubles.
Open → 2610.31868v1