Papers for

wearable technology engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multimodal models learn to decode brain signals from EEG images

Multimodal LLMs Can Learn to Read Brain Signals: A Vision--Language Model for Unified Multi-Task EEG Decoding

Abstract: Learning EEG representations that generalize across cognitive tasks, subjects, and recording conditions remains a key challenge in electroencephalography (EEG) decoding. Recent advances in foundation models have improved EEG decoding performance, yet a fundamental open question remains: how to effectively interface neural signals with these models to enable multi-task learning across datasets. To investigate this question, we introduce BraVista, a visual-language framework that encodes multichannel EEG signals as structured images and enables multi-task learning through instruction-conditioned vision-language models (VLMs). Our approach relies on continued post-training of a general-domain VLM, leveraging its visual and linguistic priors to adapt to neural signals without a separate large-scale EEG-specific pretraining stage. We evaluate BraVista on four datasets spanning sleep staging, emotion recognition, cognitive workload classification, and abnormal EEG detection, showing strong performance across these tasks. Further analyses show that the choice of EEG-to-image representation is critical to performance. Moreover, through controlled perturbations of the EEG signal, we observe a gradual performance degradation under increasing noise, suggesting that the model relies on EEG-relevant information rather than superficial visual patterns. Together, these findings establish structured visual representations as an effective and scalable interface between neural signals and general-domain foundation models for unified multi-task EEG decoding.

Wed 7 OctMachine LearningArtificial IntelligenceComputer Vision and Pattern Recognition
The gist
Reading brain signals with computers is difficult because brain activity varies a lot depending on the task and person. The authors created BraVista, a method that turns brainwave data into pictures, letting big visual and language AI models learn to understand them together. This approach works well on different brain-reading tasks like sleep stages and emotions without needing special brain data training first. They also found that how EEG data is turned into images really matters for success. Tests show the model actually uses brain signal details instead of just guessing from pictures.
Open → 2610.09355v1

Zero shot method improves eeg models with multimodal data

ZeroMAG: Zero-Shot Multimodal Adapter Generation for Plug-and-Play EEG Foundation Models

Abstract: EEG foundation models (EFMs) capture reusable knowledge from large-scale EEG data, while many EEG recordings also include companion physiological signals that provide complementary information beyond the EEG-only interface. The challenge is to preserve this pretrained knowledge while extending the EFM to heterogeneous multimodal recordings through an adaptation inferred from unlabeled target data. We introduce ZeroMAG, a zero-shot multimodal adapter generation framework that extends a frozen EEG encoder and prediction head using unlabeled target recordings, without target labels or target-side optimization. The target datasets are held out from all model training and selection in the ZeroMAG pipeline. ZeroMAG organizes companion modalities around a configuration-invariant adapter, constructs a modality-subject-task condition from unlabeled recordings and task context, and generates adapter weights in a function-constrained latent space learned from source adapters. Across six held-out target datasets and three EFM backbones, ZeroMAG improves balanced accuracy by 7.22 percentage points over EEG-only inference and 4.89 points over direct weight regression, while coming within 0.50 points of supervised multimodal adaptation on average. Ablations further show that removing functional supervision from either representation learning or conditional generation degrades generated-adapter performance, confirming the contribution of both components.

Fri 2 OctMachine Learning
The gist
EEG foundation models help understand brain signals but often ignore other body signals recorded alongside brain data. The authors present ZeroMAG, a method that improves these models by adding information from other body signals without needing extra training labels or adjustments. ZeroMAG works by generating adapters that enhance the model's understanding using unlabeled data. Testing shows it significantly improves accuracy compared to using brain signals alone and approaches the performance of fully supervised methods.
Open → 2610.03546v1

Pain assessment improved with faster neural design sharing method

Efficient Architecture Search under Leave-One-Subject-Out Evaluation

Abstract: Deep neural architectures are widely used for signal processing in automated pain assessment systems. However, architecture design has remained largely a manual task despite the potential efficiency benefits of Neural Architecture Search (NAS). Embedding NAS in a Leave-One-Subject-Out (LOSO) evaluation is computationally demanding because a fully nested implementation requires $N$ independent architecture searches and, assuming approximately linear training cost, scales as $\mathcal{O}(N^2)$. We propose a block-based, leakage-controlled approach that shares NAS runs between subjects, reducing the number of searches from $N$ to $B$, where $B \ll N$, dubbed PainNAS. On the BioVid Heat Pain dataset, PainNAS yields comparable subject-level accuracy with substantially fewer parameters and FLOPs.

Fri 18 SeptMachine Learning
The gist
Automated systems can detect pain by analyzing signals with deep neural networks, but designing these networks usually takes a lot of time and effort. The authors found a way to speed up this design process by sharing parts of the search across different people, cutting the work needed when testing on many subjects. Their method uses fewer searches and still works just as well in identifying pain signals. This makes building pain detection systems more efficient without losing accuracy.
Open → 2609.21457v1