Functional SVD improves analysis of complex multivariate data
A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization
Machine Learning
Summary
Analyzing complex data like multiple signals changing over time can be tricky. The authors developed a new method that breaks down such data into key parts while smoothing and filtering out noise. Their approach helps highlight the most important patterns and removes irrelevant variations specific to individuals. This makes it easier to understand and use the data effectively in many fields. They tested their method using simulations and real-world data and found it outperformed older techniques.
What this means in practice
- •For biomedical data analysts: Separate important physiological signal patterns from noise and individual variability in multivariate patient monitoring data.
- •For financial risk modelers: Extract smoother and more interpretable risk factors from multiple correlated financial time series under regularized constraints.
Authors
Yue Zhao, Hossein Haghbin, Rebecca Sanders, Mehdi Maadooliat
Abstract
This paper introduces a novel framework for Regularized Multivariate Functional Principal Component Analysis (ReMFPCA) via Functional Singular Value Decomposition (SVD). The proposed method extends existing MFPCA approaches by incorporating a generalized functional SVD within a Hilbert space framework, enabling simultaneous regularization of both functional principal components (PCs) and their associated PC scores. A key innovation of this framework is the inclusion of a sparsity penalty on the PC scores, which enhances interpretability by filtering out irrelevant subject-specific variations. This dual-penalization strategy represents a significant advancement beyond existing covariance-based eigen decomposition methods, which penalize only the functional PCs. Two power algorithm implementations, sequential and joint, are proposed, together with a cross-validation approach based on iterative regression for optimal smoothing parameter selection. Comprehensive simulation studies and real data applications demonstrate that the proposed framework substantially improves the extraction of informative and interpretable components, offering methodological and practical benefits for analyzing multivariate functional data across diverse domains.