Papers for

real-time monitoring teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Classifier adapts to changing data and new categories in streams

Open-world Reconstruction-based Classifier with Concept Drift Adaptation

Abstract: Data stream processing has become central to modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by recognition methods. Adapting to concept drifts while also being able to detect novel classes and distinguish groups of unknown observations can be seen as a step towards effective method employment in an open-world setting. This work proposes a classification method that can detect and learn the distributions of new, unknown classes, as well as adapt to concept drifts once the distribution of known classes shifts. The proposed method uses the autoencoders' reconstruction errors and the KDE that models their distribution. The autoencoders incrementally adapt to the changing distributions of known classes via weight fine-tuning, resulting in continuous adjustment to evolving concepts. Conducted experiments used a diverse set of synthetic data streams, embeddings of a real-world static CIFAR dataset arranged into a stream to simulate concept drifts and the emergence of unknowns, as well as real-world datasets where novelty is observed. The methodology was compared with state-of-the-art approaches with three-criterion recognition quality assessment and resource consumption evaluation. The results indicate that the proposed method is competitive with reference approaches in stationary environments and performs best when concept drifts occur.

Fri 6 NovMachine Learning
The gist
Data that changes over time, like images or sensor info, can confuse computers trying to recognize patterns. The authors developed a method that detects when new kinds of data appear and learns to recognize them, while also adjusting when the known data changes. Their system uses special neural networks called autoencoders to spot these changes and adapts continuously. Tests show it works well compared to other leading methods, especially when the data shifts or new categories show up.
Open → 2611.09350v1

Trace benchmarks streaming video models by timing and response quality

TRACE: Temporal Audit and Condition-aware Evaluation of Streaming Video Understanding

Abstract: Streaming video understanding requires models to interpret evidence as it arrives, yet current evaluations often report task scores without specifying when evidence becomes valid, how visual history is maintained, or how responses are triggered. As a result, similar scores may correspond to different workloads, failure modes, and operational behavior. We introduce TRACE (Temporal Audit and Condition-aware Evaluation), a condition-aware benchmark and evaluation framework that makes these factors explicit. TRACE combines temporally audited visual tasks with evidence timing and instruction-dependent trigger annotations, a unified causal Core--Adapter protocol that controls information availability while recording actual history processing and response events, and multidimensional reporting of answer quality, timeliness, response-selection behavior, workload, completion, and reliability. On 1,240 records from 517 videos, we evaluate eight publicly available models or systems in eight configurations. We find that nearly identical QA accuracy can mask substantial differences in completion, answer validity, and generation workload, while proactive performance separates into response quality, response delay, false alarms (responses emitted while no target window is currently valid and a later one remains), and missed target windows. These results show that streaming-video performance should be interpreted as execution-conditioned system behavior rather than a single score. Our benchmark and code can be accessed at \href{https://github.com/om-ai-lab/trace-bench}{https://github.com/om-ai-lab/trace-bench}.

Fri 25 SeptComputation and LanguageComputer Vision and Pattern Recognition
The gist
Understanding video as it streams is different from just getting one score at the end. The authors created TRACE, a way to check not only if video questions are answered right but also when answers come, how the video history is tracked, and how the models decide to respond. They tested popular models and found that similar scores can hide big differences like delays or wrong timing. This means to judge video AI better, we need to look at how they behave over time, not just their final accuracy.
Open → 2609.30670v1