Correlation aware model improves eeg brain signal decoding accuracy
CABrain: A Correlation-Aware Brain Foundation Model for EEG Decoding
Artificial IntelligenceMachine Learning
Summary
Understanding brain signals from EEG recordings is tricky because the signals come from many channels that relate to each other in complex ways. The authors developed a new method that helps the computer better understand how different channels connect by treating EEG channels like points in a network. They also designed a way to train the model that makes it better at learning from harder-to-predict parts of the data. This approach helps improve the accuracy of decoding brain activity, as shown on multiple test datasets.
What this means in practice
- •For brain computer interface developers: Improve brain signal decoding models by incorporating network based positional encoding and adaptive masking for better EEG interpretation.
- •For medical device engineers: Enhance EEG based diagnostic tools by adopting correlation aware representation learning to increase signal decoding accuracy.
Authors
SuGil Choi, Mooseop Kim, Chi Yoon Jeong
Abstract
Electroencephalography (EEG) foundation models have emerged as promising paradigms for decoding brain activity through large-scale self-supervised pretraining. Notably, most existing approaches employ masked patch reconstruction, in which randomly selected EEG patches are masked and recovered by the network. However, purely random masking may limit representation learning as informative patches from highly correlated channels often remain unmasked, causing the network to underutilize weakly correlated channels or serial dependencies. Furthermore, because these models are typically based on transformer architectures, their performance is influenced by the choice of positional encoding. Although positional encoding has been extensively explored in natural language processing and computer vision, few studies have adapted it to the unique characteristics of EEG signals. To address these limitations, this study introduces a conditional positional encoding method based on graph convolutional networks (GCNs) to explicitly model inter-channel correlations, along with an adaptive masking strategy that enhances representation learning by modulating the difficulty of masked patch reconstruction. To the best of our knowledge, this is the first study to integrate graph-based representations into conditional positional encoding and introduce adaptive masking within EEG foundation model pretraining. Experimental results on ten benchmark datasets demonstrate that the proposed GCN-based positional encoding and adaptive masking strategies, both individually and in combination, achieve state-of-the-art or competitive performance, highlighting their effectiveness in EEG foundation modeling.