Autoencoders learn separate timing and shape from complex functional data

Functional Autoencoders for Amplitude-Phase Representation Learning

Machine Learning

Summary

Functional data like heartbeats or motion can look very different if events happen at different times or with different intensities. The authors propose a new autoencoder method that can separate when things happen (phase) from how strong or shaped they are (amplitude) across multiple related signals. This separation helps the method better align and group complex signal data while reconstructing it accurately. Their method outperforms previous approaches on various tests and real-world datasets.

What this means in practice

  • For medical signal analysts: Identify and cluster patient signals like ECG or EEG with better alignment to discover patterns obscured by timing differences.
  • For speech technology engineers: Improve speech processing by separating the timing of phonemes from their acoustic shape across multiple audio features.

Authors

Peida Wu, Xinyang Xiong, Pengcheng Zeng

Abstract

Functional data are intrinsically infinite-dimensional, and often exhibit phase variation, where corresponding events occur at different times across observations. Existing linear dimension reduction methods struggle with nonlinear amplitude variation, while functional autoencoders without an explicit warp entangle temporal misalignment with shape. We propose the Amplitude--Phase Functional Autoencoders (AP-FAE), an unsupervised framework for functional data that spans both univariate and multivariate cases, with emphasis on the multivariate setting, and factorizes the latent space into separate amplitude and phase embeddings derived from all channels. A smooth functional decoder reconstructs channel-specific amplitude functions in canonical time, and a shared monotone, endpoint-preserving warp captures phase variation. We prove a bound linking amplitude recovery to registration, reconstruction, and noise errors, and validate it numerically. Across synthetic data and six real-world benchmarks, AP-FAE outperforms state-of-the-art baselines on most clustering and alignment metrics and on all reconstruction metrics. Clustering with amplitude embeddings alone consistently surpasses joint amplitude--phase clustering, confirming the benefit of explicit disentanglement. Code is available at https://anonymous.4open.science/r/APFAE-418C/}{https://anonymous.4open.science/r/APFAE-418C/.