AI driven EEG system provides proactive help for memory support
Beyond Reactive Assistance: PV-Care Using Low-Density EEG and AI to Provide Proactive, Context-Aware Help for MCI
Human-Computer Interaction
Summary
As more elderly people face memory challenges, there is a need for smarter help systems. The authors created PV-Care, which uses wearable brain sensors and cameras to understand what a person is thinking and seeing. Unlike usual assistants that wait for commands, PV-Care can start helpful conversations based on detected brain activity, like remembering or learning. It combines brain signal analysis with AI to give better, real-time voice assistance. Tests show PV-Care works well to support people with mild cognitive problems.
What this means in practice
- •For healthcare device developers: Develop wearable systems that detect cognitive states using EEG and provide timely voice assistance for elderly patients with memory issues.$Commercial implications: Enables production of smart wearable care devices targeting elderly users needing cognitive support through AI-driven proactive help.
- •For smart home system integrators: Combine brain-sensing technologies with environment cameras to create responsive home assistants that recognize user needs before being asked.
Authors
Simon L Liu, Manish Kumar Krishne Gowda
Abstract
The growing elderly population gives rise to an urgent need for intelligent support systems, particularly for individuals with Mild Cognitive Impairment (MCI). This paper presents PV-Care, a proactive AI-driven assistance scheme that integrates wearable electroencephalogram (EEG) sensing with visual environmental perception to provide real-time, context-aware voice assistance for MCI users. Unlike traditional assistant systems that passively wait for user commands, PV-Care actively initiates helpful interactions based on the user's detected brain states, including Learning, Memory Recall, and Resting, using a novel deep neural architecture named Spatial and Frequency Refinement Network (SFR-Net). By combining EEG-based cognitive-state recognition with AI-based visual analysis, PV-Care generates structured "4W-UT" prompts to guide the output of large language models (LLMs). Simulation results and user studies validate the high accuracy of the proposed SFR-Net and the effectiveness of PV-Care's context-aware assistance. These results indicate that PV-Care is a feasible and promising solution for MCI caring.