AI & ML
ReferClaw: Disambiguating User Intent for Egocentric Assistance
arXiv cs.MA0 views
arXiv:2611.07683v1 Announce Type: cross Abstract: Users of egocentric AI assistants often ask short, ambiguous questions whose intended referents cannot be uniquely resolved from video and dialogue history. For example, "Where did I leave it?" may refer to several previously handled objects. Existing VideoQA systems typically commit to a single interpretation, risking plausible but intention-misaligned answers. We introduce ReferClaw, an agentic framework that formulates egocentric streaming QA as an interactive process: the assistant asks clarifying questions to resolve user intent before answering. Three cooperating agents identify candidate interpretations, request clarification, and generate answers grounded in the resolved intent and visual evidence. A bounded, cost-aware policy balances expected information gain against user effort while limiting clarification turns and question complexity. Referclaw learns from interaction through intent-specific skill updates and process-reward-guided policy optimization with agent-level credit assignment. Evaluations on augmented egocentric QA benchmarks demonstrate improved answer accuracy and joint answer-and-grounding performance over existing baselines, alongside zero-shot transfer across datasets. These findings support interactive clarification as a practical approach to resolving online user intent in egocentric streaming assistance.
Source:https://arxiv.org/abs/2611.07683PreviousA Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least SquaresNextRadio-to-Pose Information for Gauge-Drift Correction in Cooperative Localization
Related posts
Arcjet announced a family of custom-trained AI security models last week, and it's launching on Product Hunt today. https://www.producthunt.com/products/arcjet
0dev.to
Innovating with AI in the special chemicals industry
0MIT Technology Review

The Download: empty AI climate claims, and an Nvidia investigation
0MIT Technology Review
P1.95 or P2.6: the pitch your camera picks before your client does
0dev.to
Building a Production AI Chatbot in Next.js: Architecture and Pitfalls
0dev.to
Home Assistant vs construir tu propia domótica en la nube: lo que aprendí haciendo la segunda
0dev.to