Papers for

healthcare technology firms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multimodal AI model improves detection of impaired driving states

Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving

Abstract: Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We demonstrate how ID-MAE affords significant improvements in impairment inference results on both the DIVERT dataset and existing datasets, and enables strong results in additional tasks, such as trajectory and gaze prediction. For location-matched pairs, our model achieves a paired AUC of 0.706 for impairment detection on DIVERT, compared to 0.590 without reconstruction loss, improving over existing baselines. We probe the design space in terms of input modalities, masking scheme, positional encoding, attention mechanism, and decoding. We also investigate the interaction between various impairments in training and inference, demonstrating that visually demanding distractions are separable from cognitive distractions. Code and data will be available upon acceptance.

Tue 17 NovComputer Vision and Pattern RecognitionMachine LearningRobotics
The gist
Driving safely can be tricky when people experience distractions, stress, or other impairments. The authors created a new AI model called ID-MAE that learns to predict impaired driving by looking at multiple data types, like where the driver is looking and their steering behavior, without needing lots of labeled examples. They also gathered a new driving simulator dataset with many different types of impairments to test their method. Their approach improved the accuracy of detecting impaired driving and could also predict driver gaze and movement.
Open → 2611.23211v1