Papers for

surveillance system developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Lightweight method improves camouflaged object detection using rgb polarization data

LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection

Abstract: Camouflaged object detection (COD) is an important engineering task in intelligent optical perception, but it remains challenging when targets closely resemble their surroundings. Polarization imaging provides complementary physical cues, whereas existing methods typically assume fixed multimodal input configurations and entangle intra-polarization coordination with interaction between red-green-blue (RGB) and polarization representations. We propose LGFN, a lightweight gated RGB-polarization fusion framework supporting separately optimized RGB-only and polarization-assisted configurations. A deterministic Modality Router selects the appropriate configuration according to polarization availability. In the multimodal configuration, an availability-conditioned Modality Gate calibrates the available polarization branches; the Gated Polarization Hub coordinates learned degree of linear polarization (DoLP) and angle of polarization (AoP) representations with explicit polarization cues; and RGB-Polarization Cross Fusion introduces the coordinated representation into the RGB hierarchy through controlled residual interaction. The multimodal configuration requires neither sample-dependent statistics nor handcrafted quality descriptors during inference. On the complete 230-image PCOD_1200 test set, the RGB-only configuration achieves a mean absolute error of 0.0090, a Dice score of 0.8806, and an intersection over union of 0.8144, obtaining the best results on all six metrics among the evaluated RGB-based methods. Under a common local reevaluation protocol, the multimodal configuration outperforms PolarNet and IPNet on all six metrics. Relative to IPNet, it reduces the parameter count, floating-point operations, and latency by 53.1%, 73.6%, and 63.0%, respectively.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Detecting objects that blend into their surroundings is very challenging. The authors present a new method called LGFN that combines regular color cameras (RGB) with polarization sensors to spot these hidden objects better. Their approach can work when polarization data is available or not by switching configurations. LGFN is efficient, requiring fewer computations while achieving better accuracy compared to similar methods.
Open 2609.12798v1

Interaction-aligned method improves video segment detection for action-entity queries

IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Grounding

Abstract: Video Temporal Grounding (VTG) localizes the video segment that matches a natural-language query. Many queries describe an action performed by a particular entity. Existing methods often encode the query as a whole or use general video-text interactions, without explicitly checking whether the action and entity occur together. They may therefore select a segment that contains both concepts but not the event described by the query. We propose Interaction Aligned Action-Entity Video Temporal Grounding (IAE-VTG), which models this rela?tionship at both the representation and training assignment levels. First, the Fine-grained Disentangled Interaction Module (FDIM) separates action and entity related query information and aligns it with complementary motion and appearance features. It then combines token-level interactions to build representations that capture the relationship between the action and entity. Second, Interaction-Sensitive Assignment (ISA) adds this interaction evidence to bipartite matching, so training targets are selected using both temporal overlap and semantic compatibility. This reduces supervision from temporally plausible but semantically incorrect proposals. Experiments on QVHighlights, Charades?STA, and TACoS show that IAE-VTG consistently improves strong baselines and achieves competitive or state-of-the-art performance on standard grounding metrics. Additional analyses show that the method is especially effective when similar actions or entities appear at multiple times and produces more reliable assignments for complex events.

Wed 9 SeptComputer Vision and Pattern RecognitionMultimedia
The gist
Finding the exact part of a video that shows a specific action happening with a certain object or person is hard because many methods only look for the action and object separately. The authors created a system called IAE-VTG that carefully checks whether the action and the entity actually happen together in the video. Their method breaks down the query into parts about the action and the entity, matches these with video features, and uses this combined understanding to better identify the correct video segment. Tests show it works better especially when the video shows similar actions or objects multiple times.
Open 2609.09736v1

Tracking multiple objects fairly compared with same test settings

Tracking-by-detection in Multi-object Tracking: Survey and Experiments

Abstract: Multi-object tracking (MOT) is an essential computer vision task that simultaneously tracks multiple objects in video sequences, with various applications in surveillance, autonomous navigation, and human-computer interaction. The tracking-by-detection (TBD) paradigm, which combines object detection with temporal association, has emerged as a leading approach, driven by innovative algorithms. Despite recent progress, fair evaluation of TBD-based methods remains a challenge. Many studies introduce modules such as similarity metrics, data association strategies, or motion models, but they are often evaluated under inconsistent protocols, with different baseline trackers, hyperparameters, and datasets. Such inconsistencies obscure the genuine contribution of each module and hinder objective comparison. This survey systematically reviews TBD-based MOT techniques, including similarity measurements, data association, camera motion compensation, and interpolation strategies. Starting from a minimal baseline tracker, we fairly evaluate the contributions of each method across diverse datasets and accumulate well-balanced methods. Our findings establish a strong baseline tracker and provide a foundation for the principled design of robust and versatile MOT systems suitable for real-world deployment.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Following inconsistent ways to judge how well multi-object tracking systems work, the authors review many methods that find and follow several objects in videos. They start with a simple tracker and test each addition carefully across different video sets to see what really helps. This lets them find the best balanced tracker and offers clear advice on building reliable tracking tools for real use. Their work helps separate useful improvements from just luck or mismatched comparisons.
Open 2609.08265v1

Visual tracking improves by modeling continuous spatio-temporal context

Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking

Abstract: Spatio-temporal context has become increasingly crucial for visual tracking. However, most existing approaches extract spatio-temporal cues via discrete sampling strategies, which inherently deviate from the continuity of spatio-temporal context, thereby deteriorating tracking performance. To address this challenge, we propose TLCTrack, a novel tracking framework that models token-level spatio-temporal context through continuously updated salient tokens, enabling more accurate target representation. Specifically, TLCTrack incorporates three components: Masked Unidirectional Attention (MUA), Spatial Salient Token Collection (SSTC), and Temporal Salient Token Bank (TSTB) modules. By explicitly integrating spatio-temporal context, MUA extracts discriminative targetaware spatial features in the search region. To avoid the negative impact of background on feature learning, SSTC progressively suppresses background interference, thereby enhancing target spatial representation. Finally, TSTB captures high-quality spatio-temporal information through continuous salient token updates. Extensive experiments on five benchmarks demonstrate that our method achieves superior performance over state-of-the-art trackers. Code and models are available at https://github.com/xiading123/TLCTrack.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
Visual tracking means following a moving object in video frames. Most existing methods look at pieces of the video at set time steps, but this misses the smooth changes that happen naturally over time and space. The authors propose a new way to keep track of important tokens representing the object continuously and update them to better capture its movement and appearance. This approach reduces background noise and improves how the object is recognized and followed in video. They tested their method on many benchmark datasets and found it works better than previous systems.
Open 2609.07070v1