Drone system detects subtle ground motion for wildlife and surveillance
trACT: temporal revelation Airborne Camera Trap
Computer Vision and Pattern Recognition
Summary
Monitoring animals or people from drones can be hard because of moving leaves, wind, and drone shakiness. The authors created trACT, a drone system that spots small movements even in messy backgrounds by copying how birds stare steadily while hunting. It processes video to pick out unusual motion and predicts movement to adjust the camera smoothly. Tests in forests show it can reliably watch wide areas and zoom in automatically to verify targets without human help.
What this means in practice
- •For wildlife conservation teams: Autonomously monitor animal activity in dense forests by detecting small movements against natural background motion.
- •For security drone operators: Perform precise target verification during aerial surveillance by combining motion prediction with adaptive zoom and stabilization.
Authors
Oliver Bimber, Rakesh John Amala Arokia Nathan, Mohamed Youssef, Vinayak Lal Bhatnagar, Ralf Berger, Klaus Hackländer
Abstract
Effective remote monitoring and surveillance using drones are frequently impeded by severe environmental and thermal clutter, dynamic vegetation, target camouflage, and system latency. Drawing inspiration from the hunting strategies of birds of prey that hover and stabilize their vision to isolate subtle ground motion, we introduce trACT (temporal revelation Airborne Camera Trap), a lightweight, real-time aerial robotics framework designed for autonomous consumer drones. The system integrates Temporal Max Pooling (TMP), a low-level signal processing method that transforms imperceptible movement across a rolling integration window into robust value and time encodings, with self-supervised motion anomaly detection to isolate target motion from background environmental motion caused by wind gusts and drone drift. To overcome mechanical and processing delays, trACT combines motion prediction with automated gimbal-stabilized optical zoom verification and equitable multi-target verification balancing. Extensive real-world field experiments in densely forested wildlife habitats and surveillance scenarios demonstrate that trACT successfully bridges the gap between wide-area aerial monitoring and precise, autonomous target verification under challenging operational conditions.