Papers for

surveillance system designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Proactive video assistants need better timing and response skills

From Perception to Prediction and Intervention: Benchmarking Proactive Video Assistants in Real-Life Scenarios

Abstract: Recent multimodal large language models have advanced video understanding, but existing benchmarks mainly evaluate whether models can interpret observed visual content. In real-world scenarios, assistants must additionally anticipate what assistance is needed and decide when to provide it. To address this gap, we introduce \textsc{P$^3$IBench}, a benchmark for proactive video understanding in real-life streaming scenarios. It evaluates three complementary capabilities: daily perception, risk prediction and intervention. We benchmark 12 representative open-source and proprietary video-language models, including streaming and adapted non-streaming systems. Our evaluation shows that current models struggle to make well-calibrated response decisions. Finally, we construct additional proactive training data and train \textsc{P$^3$I-Assistant-4B}, achieving improvements on several tasks, though gains remain uneven across capabilities. Together, these findings show that effective proactive assistance requires not only visual understanding, but also precise response timing and appropriate restraint.

Thu 15 OctMachine Learning
The gist
Video assistants are tools that watch videos and help by understanding what’s happening. This paper shows that current video assistants can recognize daily activities but struggle to predict risks and decide when to help. The authors created a new test to judge these abilities and built a better assistant using extra training data. Their work highlights that helping well is not just about seeing clearly but also about choosing the right moment and knowing when to hold back.
Open → 2610.21568v1

KeyRec reduces memory use for understanding long videos and streams

KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding

Abstract: Vision-language models are increasingly used to understand long videos and continuous streams. However, dense visual tokens accumulate with video duration, making long-context inference prohibitively expensive. Existing training-free visual-token selection methods reduce this cost by retaining informative tokens, but may lose coherent event evidence and fail to distinguish detailed recent observations from long-range history. We propose \textbf{KeyRec}, a training-free framework for constructing bounded visual memory. During query-agnostic writing, KeyRec preserves fine-grained recent observations in a visual cache and organizes historical evidence into a structured event bank. Candidate events are proposed according to their novelty relative to previously stored events and maintained through an online add--merge--evict update. When a question arrives, a text-only router adaptively allocates a fixed readout budget between recent and event memory, without reprocessing historical frames. KeyRec operates on model-facing visual embeddings and supports both modular encoder--projector VLMs and the encoder- and projector-free NEO-ov architecture. Across four streaming and long-video benchmarks and three VLM backbones, KeyRec achieves the best compressed performance in 13 of 15 settings using only 10\% of the dense decoder-facing visual-token budget. It outperforms the strongest compressed baseline by 2.21--18.37 points on real-time questions, achieves the best compressed result in five of six long-video settings, and performs best in every NEO-ov 2B setting.

Sat 26 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Videos and streams are long, and computers often slow down trying to watch all the details at once. The authors designed KeyRec, a system that keeps important recent moments in short-term memory and groups earlier events in a smart way to save space. It decides how much attention to give to recent versus older parts based on the question asked, without rewatching old video parts. This makes video understanding faster and more efficient without losing important details.
Open → 2609.32182v1

Semantic guided method improves object detection in misaligned thermal and RGB images

S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection

Abstract: Alignment-free RGB-T salient object detection (RGB-T SOD) aims to identify salient objects from unregistered RGB and thermal image pairs without costly pre-alignment. However, spatial misalignment breaks pixel-wise correspondence and causes feature contamination during cross-modal fusion. To address this issue, we propose S2A, a semantic-to-spatial alignment framework for alignment-free RGB-T SOD. Specifically, a global-guided hierarchical fusion module (GGHF) first exploits global semantic guidance to suppress background interference and refine hierarchical intra-modal features. Subsequently, the alignment-free cross-modal channel attention module (AFCA) globally exchanges complementary semantic information through channel-wise interaction, effectively overcoming the interference caused by local spatial misalignments. Finally, a spatial deformable cross-attention module (SDCA) predicts adaptive sampling offsets to recover local cross-modal spatial correspondence. Through this semantic-to-spatial paradigm, S2A first enables reliable cross-modal semantic interaction and subsequently performs local spatial calibration, effectively reducing misalignment-induced feature contamination. Without bells and whistles, S2A achieves highly competitive performance on multiple public alignment-free RGB-T benchmarks, demonstrating its effectiveness in alleviating misalignment-induced feature contamination.

Wed 23 SeptComputer Vision and Pattern Recognition
The gist
Detecting important objects in pairs of regular and thermal images that don't line up well can be tricky because the mismatch mixes up the data. The authors created a method called S2A that first uses overall meaning to connect the two image types and then corrects local misalignments. This approach helps to reduce confusion caused by misalignment without needing to carefully line up the images first. Their method performs well on several tests, showing it can find key objects effectively even when the two images are not perfectly matched.
Open → 2609.27413v1

Exact algorithm solves guarding problem for weak visibility polygons

Perfectly Guarding Straits: Exact Algorithms for Weak Visibility Polygons

Abstract: The Art Gallery Problem (AGP) asks for the fewest guards that see all of a simple polygon. It is $\exists\mathbb{R}$-complete, hence NP-hard. We show that for a particular class of polygons, confining guards to a single edge makes AGP exactly and efficiently solvable. We call this the Strait Guarding Problem (SGP). Its input is a weak visibility polygon (WVP): a simple polygon where every point is seen from some point of one fixed edge, the base. SGP places the fewest guards on the base that jointly see the whole polygon. First, a structural fact: guards on the base edge that cover the boundary already cover the entire interior, turning a two-dimensional covering problem into a one-dimensional one. Our main result is the Witness-Guard Algorithm, which solves SGP exactly in $O((n + \mathrm{OPT} \cdot ρ)(\log n + \log \mathrm{OPT}))$ time, where $ρ$ is the number of reflex vertices in the WVP and OPT is the minimum number of guards. It is output-sensitive and certifies optimality by a witness set of size OPT derived from its output. We also study the guarding-the-vertex version and prove a tight $Θ(n \log n)$ bound, with the lower bound following from Sorting. As a corollary of SGP, we obtain two results for altitude terrain guarding (ATG), a special case that SGP generalizes. We give a linear-time perfect-guarding algorithm, improving the previous $O(n^2 \log n)$ bound of Daescu, Friedrichs, Malik, Polishchuk and Schmidt. We also resolve their problem on the minimum guarding altitude, in $O(nk + k^2 \log k)$ time, improving on the $O(k^2 λ_{k-1}(n) \log n)$ bound of Kang, Kim and Ahn.

Mon 14 SeptComputational GeometryDiscrete MathematicsData Structures and Algorithms
The gist
The paper addresses a problem called the Art Gallery Problem, which asks how to place the fewest guards to see every part of a shape. The authors focus on a special kind of shape where every point can be seen from some point along one particular edge. They show that placing guards only on this edge makes the problem easier to solve exactly and efficiently. Their method finds the smallest number of guards needed and is faster than previous approaches for related problems.
Open → 2609.15510v1