Clustering time series from dynamical systems using occupation kernels
The Clustering Occupation Kernel (CLOCK) Method for Time Series Arising from Dynamical Systems
Machine Learning
Summary
Clustering different time series data from complex systems like weather or brain signals can be difficult, especially when the data varies in length and timing. The authors introduce a new method called CLOCK that represents these sequences in a special mathematical space to compare their patterns more accurately. This method works even when the data is irregular or noisy and can handle different lengths of sequences. They tested CLOCK using simulated models and real brain EEG data, showing it often groups similar time series better than other methods.
What this means in practice
- •For medical data analysts: Group EEG time series into meaningful clusters to improve brain activity analysis and diagnosis.
- •For climate modelers: Compare and classify time series from climate simulations to understand system dynamics more accurately.
Authors
Michael L. Wells, Kamel Lahouel, Victor Rielly, Bruno Jedynak
Abstract
We introduce the Clustering Occupation Kernel (CLOCK) method, a novel representation-based framework for clustering time series arising from dynamical systems. CLOCK embeds observed sequences into a reproducing kernel Hilbert space (RKHS) via a time-averaged occupation kernel, enabling trajectory comparison through their RKHS norm. For systems governed by differential equations, this formulation rigorously approximates the kernel mean embedding of the invariant Sinai-Ruelle-Bowen (SRB) measure, meaning our dissimilarity metric approximates the maximum mean discrepancy (MMD) between attractors. To accommodate general time series, we introduce time lags via Takens' Embedding Theorem to reconstruct the phase space. Crucially, CLOCK natively handles trajectories of unequal lengths and irregularly-spaced observations. We validate the proposed metric using spectral clustering, demonstrating superior performance against benchmark methods on both synthetic datasets and a real-world intracranial large-scale electroencephalogram (EEG) dataset. Finally, ablation studies on the Lorenz-96 system are consistent with the theoretical convergence rates of the occupation kernels and highlight the method's strong robustness to zero-mean Gaussian noise.