Papers for

streaming data engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Online tracking costs rise sharply without future knowledge

The Cost of Missed States: Online Tracking with Current-Observation Resets

Abstract: An online tracker retains one state and may reset only to the current observation, although its complete observed history is available. Offline knows the future and obeys the same reset rule. Under a hard discrepancy radius, for every horizon $T\ge5$ and every feasible randomized causal policy, a fixed path on a known five-point metric requires at least $(T+1)/2$ expected refreshes, against exactly two offline refreshes with a strict radius margin. Missing the useful prefix center forces a refresh at every suffix observation. The path visits four values, with resolution fixed as $T$ grows. Write $J_λ$ for cumulative discrepancy plus a charge $λ>0$ per refresh, and $V_T$ for the sum of successive observation distances. A candidate prefix adapts Bienkowski and Schmid's randomized lower bound to this objective under current resets, even with a known horizon and $V_T<3λ$. This construction needs finer grids; a fixed finite metric with positive minimum separation instead admits a competitive policy for penalized tracking. An anytime policy satisfies $J_λ\leλ+4\sqrt{λTV_T}$ without knowing the horizon or final variation. Clipping for a known horizon gives $J_λ\leλT$ and a factor-three comparison with the minimum of three analytical bounds, without knowing final variation. Current-value diameter and readout sensitivity give same-input output bounds for mixtures, including squared-distance softmax.

Wed 21 OctData Structures and Algorithms
The gist
This work studies how tracking systems that update their state only based on the current observation face unavoidable costs when they can't look ahead. The authors show mathematically that for certain paths, an online tracker must refresh its state much more often than an offline tracker that knows the future. They develop bounds on these refresh costs and propose policies that give good guarantees even without knowing the total tracking time or variation in the data. Their findings clarify fundamental limits and efficient strategies for tracking with resets limited to the present observation.
Open → 2610.30505v1

Quantum computing aids network security classification with memory efficiency

Quantum Computing for Network Security Classification: Near-Term Classification and Long-Term Memory Efficiency

Abstract: Quantum computing has already been explored in several network-security applications. However, how quantum computing may contribute to network-security classification in both the near term and the longer term has not been systematically discussed. This paper studies this question through two complementary experiments. First, we evaluate near-term quantum-kernel support vector machines (SVMs) on practical network-security classification tasks and compare them with classical SVM baselines on KDD Cup 1999, CICIDS2017, and BoT-IoT. Across these runs, quantum kernels are competitive. They can match or improve classical baselines in some settings, while classical RBF kernels remain stronger in others. This suggests that near-term quantum-kernel methods should be evaluated as practical, dataset-dependent alternatives to classical kernels rather than as uniformly superior replacements. Second, we use quantum oracle sketching (QOS) to study a longer-term memory advantage for classification with streaming classical samples. In QOS, samples are processed online and used to incrementally construct an approximate quantum oracle, which provides coherent query access for downstream quantum algorithms without retaining the entire dataset. Under the QOS-inspired machine-size estimate, comparable accuracy corresponds to a substantially smaller effective memory-size proxy than explicit sparse/QRAM-style storage. Compared with a simple streaming proxy, the result is more nuanced because aggressive feature filtering can make the streaming dimension small. This suggests that the long-term value of quantum computing for network-security classification may lie in memory-efficient data access rather than immediate runtime speedup. Together, these experiments show how quantum computing may contribute to network-security classification from near-term classification performance and longer-term memory efficiency.

Tue 29 SeptArtificial IntelligenceMachine Learning
The gist
Network security systems need to classify data accurately and efficiently. The authors studied how quantum computing can help both now and in the future. They found that current quantum methods can match or sometimes improve classical techniques depending on the dataset. For longer-term use, quantum approaches might save memory by storing data more efficiently, helping future systems handle big streams of security data better.
Open → 2609.36479v1