Papers for
surveillance system designers
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Proactive video assistants need better timing and response skills
From Perception to Prediction and Intervention: Benchmarking Proactive Video Assistants in Real-Life Scenarios
Abstract: Recent multimodal large language models have advanced video understanding, but existing benchmarks mainly evaluate whether models can interpret observed visual content. In real-world scenarios, assistants must additionally anticipate what assistance is needed and decide when to provide it. To address this gap, we introduce \textsc{P$^3$IBench}, a benchmark for proactive video understanding in real-life streaming scenarios. It evaluates three complementary capabilities: daily perception, risk prediction and intervention. We benchmark 12 representative open-source and proprietary video-language models, including streaming and adapted non-streaming systems. Our evaluation shows that current models struggle to make well-calibrated response decisions. Finally, we construct additional proactive training data and train \textsc{P$^3$I-Assistant-4B}, achieving improvements on several tasks, though gains remain uneven across capabilities. Together, these findings show that effective proactive assistance requires not only visual understanding, but also precise response timing and appropriate restraint.
KeyRec reduces memory use for understanding long videos and streams
KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding
Abstract: Vision-language models are increasingly used to understand long videos and continuous streams. However, dense visual tokens accumulate with video duration, making long-context inference prohibitively expensive. Existing training-free visual-token selection methods reduce this cost by retaining informative tokens, but may lose coherent event evidence and fail to distinguish detailed recent observations from long-range history. We propose \textbf{KeyRec}, a training-free framework for constructing bounded visual memory. During query-agnostic writing, KeyRec preserves fine-grained recent observations in a visual cache and organizes historical evidence into a structured event bank. Candidate events are proposed according to their novelty relative to previously stored events and maintained through an online add--merge--evict update. When a question arrives, a text-only router adaptively allocates a fixed readout budget between recent and event memory, without reprocessing historical frames. KeyRec operates on model-facing visual embeddings and supports both modular encoder--projector VLMs and the encoder- and projector-free NEO-ov architecture. Across four streaming and long-video benchmarks and three VLM backbones, KeyRec achieves the best compressed performance in 13 of 15 settings using only 10\% of the dense decoder-facing visual-token budget. It outperforms the strongest compressed baseline by 2.21--18.37 points on real-time questions, achieves the best compressed result in five of six long-video settings, and performs best in every NEO-ov 2B setting.
Semantic guided method improves object detection in misaligned thermal and RGB images
S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection
Abstract: Alignment-free RGB-T salient object detection (RGB-T SOD) aims to identify salient objects from unregistered RGB and thermal image pairs without costly pre-alignment. However, spatial misalignment breaks pixel-wise correspondence and causes feature contamination during cross-modal fusion. To address this issue, we propose S2A, a semantic-to-spatial alignment framework for alignment-free RGB-T SOD. Specifically, a global-guided hierarchical fusion module (GGHF) first exploits global semantic guidance to suppress background interference and refine hierarchical intra-modal features. Subsequently, the alignment-free cross-modal channel attention module (AFCA) globally exchanges complementary semantic information through channel-wise interaction, effectively overcoming the interference caused by local spatial misalignments. Finally, a spatial deformable cross-attention module (SDCA) predicts adaptive sampling offsets to recover local cross-modal spatial correspondence. Through this semantic-to-spatial paradigm, S2A first enables reliable cross-modal semantic interaction and subsequently performs local spatial calibration, effectively reducing misalignment-induced feature contamination. Without bells and whistles, S2A achieves highly competitive performance on multiple public alignment-free RGB-T benchmarks, demonstrating its effectiveness in alleviating misalignment-induced feature contamination.
Exact algorithm solves guarding problem for weak visibility polygons
Perfectly Guarding Straits: Exact Algorithms for Weak Visibility Polygons
Abstract: The Art Gallery Problem (AGP) asks for the fewest guards that see all of a simple polygon. It is $\exists\mathbb{R}$-complete, hence NP-hard. We show that for a particular class of polygons, confining guards to a single edge makes AGP exactly and efficiently solvable. We call this the Strait Guarding Problem (SGP). Its input is a weak visibility polygon (WVP): a simple polygon where every point is seen from some point of one fixed edge, the base. SGP places the fewest guards on the base that jointly see the whole polygon. First, a structural fact: guards on the base edge that cover the boundary already cover the entire interior, turning a two-dimensional covering problem into a one-dimensional one. Our main result is the Witness-Guard Algorithm, which solves SGP exactly in $O((n + \mathrm{OPT} \cdot ρ)(\log n + \log \mathrm{OPT}))$ time, where $ρ$ is the number of reflex vertices in the WVP and OPT is the minimum number of guards. It is output-sensitive and certifies optimality by a witness set of size OPT derived from its output. We also study the guarding-the-vertex version and prove a tight $Θ(n \log n)$ bound, with the lower bound following from Sorting. As a corollary of SGP, we obtain two results for altitude terrain guarding (ATG), a special case that SGP generalizes. We give a linear-time perfect-guarding algorithm, improving the previous $O(n^2 \log n)$ bound of Daescu, Friedrichs, Malik, Polishchuk and Schmidt. We also resolve their problem on the minimum guarding altitude, in $O(nk + k^2 \log k)$ time, improving on the $O(k^2 λ_{k-1}(n) \log n)$ bound of Kang, Kim and Ahn.