AI & ML
WSM-Aware HRI: An IoT-Enhanced Framework for Early Detection and Norm-Guided Repair of Failures with LLM Guidance
arXiv cs.HC0 views
arXiv:2609.32336v2 Announce Type: replace-cross Abstract: Human-robot interaction (HRI) failures remain a major barrier to deploying robots in real-world environments. Prior work often treats failures as isolated technical faults or focuses on post-hoc recovery behaviors. In practice, many breakdowns arise because humans and robots operate under inconsistent assumptions about the current world state. We propose WSM-Aware HRI, an IoT-enhanced modular framework that unifies diverse HRI breakdowns as World-State Mismatches (WSMs) between a human's instruction-implied assumptions and a robot's grounded world model built from multimodal perception and digital augmentation. A Large Language Model (LLM) is used to make implicit assumptions explicit, map them to a small set of mismatch types, and specify the evidence needed for verification against the robot's world state. WSM-Aware HRI shifts failure handling from execution-time recovery to proactive mismatch detection during intention formation, enabling interventions guided by safety, norm compliance, and multi-user coordination with transparent explanations. We evaluate mismatch identification in ten everyday cases spanning both visual and latent-state mismatches. The system can accurately produce the expected output results, and ablations show that reliable identification depends on appropriate grounding representations and verification-oriented refinement. These results indicate that treating interaction breakdowns as explicit world-state mismatches enables earlier detection of impending failures and offers a principled mechanism for integrating external evidence and social constraints into human-robot interaction.
Source:https://arxiv.org/abs/2609.32336PreviousTriDeliver: Cooperative Air-Ground Instant Delivery with UAVs, Couriers, and Crowdsourced Ground VehiclesNextA Spectral Representation Of The Simple Hypothesis Testing Problem
Related posts

Keep Distributed Training Running with Automated Workload Recovery
0NVIDIA Developer Blog

Diagnose Distributed AI Workload Failures with NVIDIA Attribution
0NVIDIA Developer Blog
Alibaba Lab Cuts AI Upgrade Bills By Rewriting Core Numbers
0dev.to AI
Regalos para la persona que tiene un negocio pequeno, ensena, o crea cosas (en espanol)
0dev.to AI
CrowdStrike Expands Project QuiltWorks Across Europe
0dev.to AI
Lighthouse 13.6 Can Raise PageSpeed Insights Scores Without a Site Change
0dev.to AI