AI & ML
Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving
arXiv cs.RO0 views
arXiv:2611.23211v2 Announce Type: replace-cross Abstract: Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We demonstrate how ID-MAE affords significant improvements in impairment inference results on both the DIVERT dataset and existing datasets, and enables strong results in additional tasks, such as trajectory and gaze prediction. For location-matched pairs, our model achieves a paired AUC of 0.706 for impairment detection on DIVERT, compared to 0.590 without reconstruction loss, improving over existing baselines. We probe the design space in terms of input modalities, masking scheme, positional encoding, attention mechanism, and decoding. We also investigate the interaction between various impairments in training and inference, demonstrating that visually demanding distractions are separable from cognitive distractions. Code and data will be available upon acceptance.
Source:https://arxiv.org/abs/2611.23211PreviousCoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg LearningNextBuild Tool-Calling Parsers in Rust with AI Agents
Related posts
CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning
0arXiv cs.RO
Meta-RL with Bayesian Linear Task Models
0arXiv cs.RO
RFW-S: Everyday Deformable Objects with Independent Simulation Verification
0arXiv cs.RO
Heave-Ho: Decentralized Long-Horizon Multi-Humanoid Collaboration
0arXiv cs.RO
CriticHack: Evaluating Visual Rewards Under Robot Policy Optimization
0arXiv cs.RO
SPARSER: Sparse Variable Projection by Exploiting Separable Structure in Robotic Perception
0arXiv cs.RO