Papers for

security system engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Occlusion-robust system keeps tracking targets through long disappearances

Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion

Abstract: Real-time multi-object tracking systems remain highly vulnerable to full and long-term occlusion, where targets temporarily or completely disappear from the camera's field of view. Conventional trackers may terminate trajectories prematurely, resulting in identity loss and reduced situational awareness in applications such as defense and surveillance. This work proposes an occlusion-robust target tracking framework that maintains target identity and trajectory continuity through the integration of YOLOv11n object detection, Kalman Filter motion prediction, and occlusion-aware appearance-based re-identification. The framework consists of three stages: object detection, position estimation during occlusion, and identity recovery after target reappearance. Six Re-Identification (Re-ID) architectures were evaluated within the same tracking framework under identical conditions, with the Occlusion-Aware Mask Network (OAMN) achieving the best overall performance and therefore selected for the final pipeline. The framework was benchmarked against OccluTrack on the public OVIS dataset, achieving relative improvements of 18.1 percent in Multiple Object Tracking Accuracy (MOTA) and 25.1 percent in Identity F1 Score (IDF1), while reducing identity switches by 12.8 percent. On a custom military dataset simulating surveillance and battlefield-like environments with long-term occlusion, the framework achieved a MOTA of 0.734 and an IDF1 of 0.729, corresponding to relative improvements of 14.2 percent and 5.8 percent over OccluTrack. The system demonstrated strong tracking continuity, robust identity preservation, and reliable trajectory estimation under challenging occlusion conditions, highlighting its effectiveness for defense-related surveillance applications requiring continuous target tracking during visibility loss.

Tue 15 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Tracking objects in videos is hard when the objects disappear behind obstacles or leave the camera view for a while. The authors created a system that can predict where these objects move during the disappearances and correctly identify them when they reappear. They combined object detection, motion prediction, and special appearance recognition to do this. Their method works better than previous ones, especially in tough conditions like military surveillance.
Open 2609.17427v1

Facial landmark detection improved by noise adaptive frequency filtering

FAHCD-Net: Frequency-Adaptive Heatmap-Conditional Diffusion Networks for Robust Facial Landmark Detection

Abstract: Facial Landmark Detection(FLD) is a crucial task in various applications and has achieved significant advancements in recent years. However, current FLD methods still struggle under challenging conditions, where facial structural variations, information loss, and noise interference severely compromise the integrity and accuracy of learned facial features. To address these issues, we propose Frequency-Adaptive Heatmap-Conditional Diffusion Network (FAHCD-Net), which integrates a Frequency-Adaptive Heatmap-Conditional Diffusion (FAHCD) model with a Smoothness Regularization (SR) loss in a cascaded framework. Specifically, the FAHCD model incorporates a Hierarchical Frequency Adaptation (HFA) module designed to suppress redundant high-frequency noise through multi-layer frequency decomposition and adaptive reconstruction, thereby preserving essential facial structures. Additionally, the SR loss is proposed to further mitigate the interference of high-frequency noise and enhance the smoothness of the generated landmark heatmaps. By cascading the FAHCD model with the SR loss, FAHCD-Net effectively leverages both statistical and frequency-based distribution characteristics of the data to progressively generate more accurate landmark heatmaps from noisy inputs. Extensive experiments on popular benchmarks demonstrate the effectiveness and robustness of the proposed method, achieving state-of-the-art performance in FLD tasks under challenging scenarios. The source code is available at https://github.com/HJWKryptonite/FAHCD-Net.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Facial landmark detection means finding key points on a face, which is important for things like face recognition and animation. The problem is that noise and changes in facial structure can confuse current methods and reduce accuracy. The authors introduce FAHCD-Net, which uses a special step that targets and reduces noisy signals while keeping important face details, producing clearer maps of facial landmarks. They also add a smoothness check to make the results less jumpy, improving performance on tricky images.
Open 2609.16842v1

Restoration guided by recognition task improves face identification accuracy

Restore What Matters: Lessons from Joint Restoration and Recognition

Abstract: Recognition pipelines typically adopt a restore-then-recognize workflow, yet decades of experience show that generating visually pleasing images seldom translates to improved recognition. We propose a Joint Restoration-for-Recognition (JR$^2$) paradigm: restore only what downstream tasks truly require, with task signals dictating where, how much, and whether restoration is necessary. JR$^2$ rests on three pillars: (i) Physics, employing optics-accurate turbulence simulation, extensible to blur and noise, to ground restoration in real image formation; (ii) Neuroscience, drawing on selective attention and neuroplasticity to direct model capacity toward identity-critical regions and frames while bypassing already-clean inputs; and (iii) Vision & Learning, coupling recognition loss end-to-end through restoration and alignment so that low-level edits maximize high-level identity stability. Evaluations on IARPA-BRIAR show consistent improvements (e.g., TAR@0.01% FAR +0.6; FNIR@1% FPIR -2.5), while a quality gate skips ~70% of clean frames, reducing cost. Ablations confirm physics priors enhance realism, joint training prevents catastrophic forgetting, and selective restoration suffices in many cases. We conclude that better-looking images are neither necessary nor sufficient; restoration modules must be task-driven, selective, and physically aware. Code, pretrained models, and recipes are provided for integration.

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Traditional methods try to clean up images first and then identify people, but this doesn’t always help recognition. The authors suggest focusing restoration only on parts of images needed for identifying faces, guided by the recognition task itself. They combine physics-based image modeling, insights about human attention, and end-to-end learning to improve accuracy. Tests show better recognition rates and efficiency by skipping restoration when unnecessary.
Open 2609.13791v1

Vision language models improve unseen medical image detection accuracy

Layer Selection in VLMs for Zero-Shot OOD Detection via Multi-Resolution Entropy Estimation

Abstract: Out-of-distribution (OOD) detection is crucial for safe deployment of medical AI systems, where domain shifts arise across institutions, acquisition protocols, and patient populations. VLMs enable zero-shot OOD detection by embedding images into a language-aligned latent space, where cross-modal similarity serves as a non-parametric confidence signal for identifying in-distribution samples. Yet existing methods rely almost exclusively on final-layer embeddings, implicitly assuming that the deepest representations are universally optimal. We first show that this assumption does not hold in medical imaging: intermediate layers provide complementary OOD signals, and the optimal representational depth depends on the respective image modality. While prior work selects layer combinations via entropy minimization of normalized histograms, we demonstrate that single-resolution entropy estimation is highly sensitive to binning choices, leading to performance variations of up to 19.3% AUROC. To address this instability, we propose a multi-resolution entropy estimation strategy that aggregates histogram statistics across multiple discretization scales, enabling robust and stable intermediate-layer selection. Across two medical OOD benchmarks, namely MIDOG and OASIS, covering distinct imaging modalities, diverse shift types, and different VLM backbones, our method consistently outperforms state-of-the-art approaches, offering a lightweight and stable solution for zero-shot OOD detection.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Detecting unusual or unexpected medical images is important for ensuring AI tools work safely in hospitals. The researchers found that using information from different layers inside vision-language AI models, instead of just the final layer, helps detect these unusual images better. They also created a new way to measure the uncertainty in different layers that is more stable and reliable. Testing on medical imaging benchmarks, their method consistently improved detection of out-of-distribution scans without needing extra training.
Open 2609.08524v1

Vision language models improve video anomaly detection in distributed surveillance

Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection

Abstract: How can vision-language models help video anomaly detection (VAD) when surveillance data remain distributed, weakly labeled, and resource-constrained? Most weakly supervised VAD methods assume centralized training; recent VLM-based extensions further rely on dense inference, generated explanations, or additional adaptation. We introduce a lightweight federated MIL-VLM cascade in which only a compact MIL scorer is trained across clients, while a frozen VLM verifies high-scoring suspect segments post hoc. We study two VLM feedback interfaces: parsed text-generation decisions and a logit-based interface that extracts a continuous anomaly score from next-token Yes/No probabilities. Experiments on UCF-Crime with InternVL3.5-2B and Qwen3-VL-2B-Instruct show that text-generation verification can improve frame-level AUC after diagnostic temporal post-processing, but remains sensitive to prompts, parsers, model choice, and smoothing. In contrast, the logit interface provides a fixed parser-free signal that improves both frame-level AUC and frame-level AP over the MIL baseline across both VLMs, without temporal post-processing in its main configuration. Since suspect segments are updated independently once available, next-token logit feedback provides a simple segment-local alternative to text-generation verification.

Mon 7 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Detecting unusual events in surveillance videos is hard when data is spread out and labels are unclear. This paper shows how vision-language models can help by checking suspicious video segments after a simple scoring step is trained in many locations without sharing data. They compare two ways of getting feedback from these models—one uses generated text, and the other uses direct scoring without relying on text. The direct scoring approach worked better, giving more accurate detection without extra complicated processing.
Open 2609.07455v1