AI & ML
Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving
arXiv cs.RO0 views
arXiv:2611.23211v2 Announce Type: replace-cross Abstract: Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We demonstrate how ID-MAE affords significant improvements in impairment inference results on both the DIVERT dataset and existing datasets, and enables strong results in additional tasks, such as trajectory and gaze prediction. For location-matched pairs, our model achieves a paired AUC of 0.706 for impairment detection on DIVERT, compared to 0.590 without reconstruction loss, improving over existing baselines. We probe the design space in terms of input modalities, masking scheme, positional encoding, attention mechanism, and decoding. We also investigate the interaction between various impairments in training and inference, demonstrating that visually demanding distractions are separable from cognitive distractions. Code and data will be available upon acceptance.
Source:https://arxiv.org/abs/2611.23211PreviousCoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg LearningNextBuild Tool-Calling Parsers in Rust with AI Agents
Related posts
When the Caller Cuts In: Keeping a Voice Agent's Memory to What Was Actually Heard
0dev.to TypeScript
core.fsmonitor is a program exactly when git cannot read it as a boolean
0dev.to Go

Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod
0AWS Machine Learning Blog
CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning
0arXiv cs.RO
Meta-RL with Bayesian Linear Task Models
0arXiv cs.RO
RFW-S: Everyday Deformable Objects with Independent Simulation Verification
0arXiv cs.RO