Papers for

aerial surveillance teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

FlyingDrones dataset improves drone motion estimation from images

FlyingDrones: A Dataset and Benchmark for Optical Flow Estimation from UAV motion

Abstract: Optical flow is an important cue for drone analysis in aerial surveillance, airspace monitoring, and long-range target tracking, where motion remains informative when appearance is weak. Estimating the motion of small Unmanned Aerial Vehicles, however, is difficult because distant targets occupy few pixels, have low contrast, and move against complex dynamic backgrounds. Standard optical-flow benchmarks emphasize large, object-centric motions and therefore do not characterize distant aerial targets well. We introduce FlyingDrones, a generated benchmark with dense ground-truth optical flow and segmentation masks derived from physically based rendering, and define resolution-normalized metrics (EPE Norm) that normalize flow by image dimensions. We evaluate 16 state-of-the-art model families on a motion- and size-stratified subset of 999 flow pairs at three resolutions. Every family recovers drone motion better than the zero-flow reference, but the gap between families widens with resolution: at 1920x1080, global-matching, recurrent, transformer, and short-window temporal models separate clearly from pyramid, classical, self-supervised, lightweight, and diffusion models. Within-family checkpoint spread is comparable to or larger than between-family spread, so the training curriculum is as important as the architecture. Two complementary studies test the benchmark beyond synthetic accuracy: a ground-truth-free motion-alignment evaluation on 21 cameras of real UAV footage shows that the synthetic ranking carries a moderate, significant signal about real-world performance (Spearman \r{ho} = 0.63 over 41 checkpoints) while the exact top ranks differ, and a fine-tuning study shows that 800 FlyingDrones pairs reduce held-out drone-region error by up to 37% and improve drone localization on the real footage for all four architectures tested.

Thu 5 NovComputer Vision and Pattern Recognition
The gist
Tracking small drones in the sky using video is hard because they look tiny and blend into complex backgrounds. The authors created FlyingDrones, a new dataset with detailed motion information of drones in images, helping computer programs learn to better estimate drone movement. They tested many existing methods on this dataset and found which work best, especially at high image resolution. Their work also improves drone tracking on real videos after training on FlyingDrones data.
Open → 2611.07705v1

Infrared target detection improves with zoom guided interactive method

IRSTD-Agent: Agentic Infrared Small Target Detection via Zoom-Guided Interaction Learning

Abstract: Infrared small-target detection plays an important role in maritime monitoring and aerial surveillance. Although multimodal large language models (MLLMs) offer promising capabilities for visual understanding, existing MLLM-based approaches struggle to precisely localize infrared small targets. In this paper, we propose IRSTD-Agent, an agentic framework for infrared small target detection through dynamic visual search. The framework enables an MLLM to adaptively determine where and at what scale to inspect an image and progressively gather fine-grained visual evidence for precise target localization. Five complementary visual tools (PROPOSAL, ZOOM, DETECT, DROP and REFINE) support object candidate discovery, adaptive observation, target localization, hypothesis rejection, and target extent refinement, together enabling a coordinated search process over original-resolution images. To teach the MLLMs to conduct this search, we introduce Zoom-guided Interaction Learning, which uses annotation-derived interaction trajectories to supervise tool selection and the corresponding arguments. Through extensive experiments on WideIRSTD-Full and IRSTD-1k datasets, we demonstrate that IRSTD-Agent outperforms the evaluated vision-language models and enhances the precise localization capabilities of MLLMs in IRSTD tasks.

Sun 4 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Detecting tiny objects in infrared images is important for things like monitoring the ocean or skies. The authors created a system called IRSTD-Agent that helps a computer model decide where to look and how closely to examine parts of an image. This step-by-step search uses different tools to find and pinpoint small targets more accurately. Their method teaches the model to choose the right tools based on example searches and improves results on standard infrared image tests.
Open → 2610.05342v1