rescue robotics teams

Abstract: Reliable 3D person detection is important for rescue robotics to give first responders situational awareness. Yet most multimodal 3D detection research targets automotive scenarios in which pedestrians mostly appear in a narrow range of upright, near-road poses. It is therefore unclear how much of the reported performance transfers to rescue settings, as a person may be lying, partially occluded, or in unstructured indoor and outdoor environments. To investigate this gap, we introduce TriSAR-3D, a multimodal person detection dataset recorded with a high-resolution 128-channel LiDAR, an RGB camera, and a thermal camera. It captures varied poses in indoor as well as outdoor locations at different times of day to study their influence on 3D object detector performance. Furthermore, we propose a novel trimodal 3D detection pipeline, PaintFusion, that fuses PointPainting-based evidence using a simple MLP. We show that the derived method reaches 65.4 AP@50 and thereby outperforms strong LiDAR-only (CenterPoint, 53.4), RGB+LiDAR (BEVFusion, 60.5), and adapted trimodal (Tri-BEVFusion, 60.7) baselines on the dataset. At the same time, it is substantially faster than other fusion-based methods such as BEVFusion, with a per-frame latency of 51.6 ms compared to 101 ms. Additionally, we test how the performance of different 3D object detectors generalizes to unseen pose categories. Removing lying instances from training data collapses the lying-pose AP@50 to near zero across all evaluated detectors. The results indicate that dataset diversity exerts a large effect on 3D object detection performance. The dataset and code are available at https://github.com/MarkusKramer1/3D-Trimodal-People-Detection.

Abstract: Parallel wire-driven systems are a framework in which multiple wires are connected to an end effector, and the end effector is driven by the tensions of those wires. Because they can transmit large forces, up to the breaking strength of the wires, over lengths on the order of several tens of meters, they can realize powerful actuation in large workspaces. In recent years, studies have also investigated connecting wires to external environments such as trees and columns and forming parallel wire actuation on site. However, conventional parallel wire-driven systems often assume a single end effector, and because of interference between wires and links in a shared workspace, it has been difficult to handle multiple floating links simultaneously. In this study, we realize multi-floating-link parallel wire actuation by introducing an inter-body wire. In real-robot experiments, the two bodies supported and lifted a mannequin and transferred it onto a stretcher as a rescue motion. This shows that parallel wire actuation can be extended from a single end effector to a multi-floating-link system, and indicates its potential for broader tasks such as the manipulation of large objects and rescue support.