AI & ML
WSM-Aware HRI: An IoT-Enhanced Framework for Early Detection and Norm-Guided Repair of Failures with LLM Guidance
arXiv cs.HC0 views
arXiv:2609.32336v2 Announce Type: replace-cross Abstract: Human-robot interaction (HRI) failures remain a major barrier to deploying robots in real-world environments. Prior work often treats failures as isolated technical faults or focuses on post-hoc recovery behaviors. In practice, many breakdowns arise because humans and robots operate under inconsistent assumptions about the current world state. We propose WSM-Aware HRI, an IoT-enhanced modular framework that unifies diverse HRI breakdowns as World-State Mismatches (WSMs) between a human's instruction-implied assumptions and a robot's grounded world model built from multimodal perception and digital augmentation. A Large Language Model (LLM) is used to make implicit assumptions explicit, map them to a small set of mismatch types, and specify the evidence needed for verification against the robot's world state. WSM-Aware HRI shifts failure handling from execution-time recovery to proactive mismatch detection during intention formation, enabling interventions guided by safety, norm compliance, and multi-user coordination with transparent explanations. We evaluate mismatch identification in ten everyday cases spanning both visual and latent-state mismatches. The system can accurately produce the expected output results, and ablations show that reliable identification depends on appropriate grounding representations and verification-oriented refinement. These results indicate that treating interaction breakdowns as explicit world-state mismatches enables earlier detection of impending failures and offers a principled mechanism for integrating external evidence and social constraints into human-robot interaction.
Source:https://arxiv.org/abs/2609.32336PreviousTriDeliver: Cooperative Air-Ground Instant Delivery with UAVs, Couriers, and Crowdsourced Ground VehiclesNextA Spectral Representation Of The Simple Hypothesis Testing Problem
Related posts

'Demand is already well ahead of what we can build': This US factory claims its 'one large robot' can build circuit boards faster than its Chinese competition
0TechRadar

Garmin explains the process behind the Fenix 9 Pro and Marq Gen 3's new titanium case
0TechRadar

Proton apologizes to community after internal memo shows force behind proposed AI use in building its privacy products
0TechRadar

The Microsoft Surface Laptop Ultra releases a patch to fix 'reliability and performance' issues found by reviewers — so should you save your money for now?
0TechRadar

Apple spent a record $45.77 billion on R&D in fiscal 2026, up 32%
09to5Mac

What’s new in Android Nov. 2026 Google System Updates: Android photo backup with Quick Share for Windows
09to5Google