AI & ML
Breaking the Modality Barrier: Multimodal Fusion With Missing Modalities for Cybersickness Prediction
arXiv cs.HC0 views
arXiv:2611.07386v1 Announce Type: new Abstract: Cybersickness is a major barrier to comfortable VR use, and reliable prediction often requires multiple physiological and behavioral sensors. However, existing models typically assume a fixed set of modalities, making them vulnerable when sensors are unavailable and difficult to generalize across datasets with different sensor configurations. We adapt a transformer-based model that handles arbitrary sensor combinations without imputing missing data. Anchor-based contrastive learning maps heterogeneous sensor embeddings into a shared latent space using eye tracking as the anchor modality, while masked self-attention excludes unavailable sensors during fusion. We evaluate our approach on three publicly available cybersickness datasets: VR.net, SIM21, and Blur-Rollercoaster, collected using different VR systems and sensor configurations. Across single-sensor dropout conditions, prediction error changes by less than 0.09 MAE. Joint training across all datasets achieves 0.51 MAE and 0.63 Pearson correlation, substantially outperforming single-dataset models. These results demonstrate robust and generalizable cybersickness prediction across diverse VR systems.
Source:https://arxiv.org/abs/2611.07386PreviousSlide to Report: Continuous Reporting Symptom-Specific Cybersickness in VRNextThinking Is Not Writing: Designing AI Chatbots to Connect Reasoning and Revision
Related posts

Count outcomes, not agents
0dev.to
Scientist World turns 1,000 papers into executable research environments
0dev.to
I struggle to believe that AI R&D is ingenious
0Hacker News
Palo Alto Networks in talks to buy AI agent security startup Clutch for $500M
0TechCrunch
I built a vocabulary battle game for English learners — and my crowdfunding is still at zero backers
0dev.to
Meta Just Bought Conductor — the Race in AI Coding Is No Longer About the Model
0dev.to