Open Source
EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses
arXiv cs.HC0 views
arXiv:2611.09089v1 Announce Type: cross Abstract: Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io
Source:https://arxiv.org/abs/2611.09089Previous"A Space Where I Can Be Myself": Exploring Safe Visibility for Graduate Student Mothers in Mom CafesNextRAG-Enhanced LLMs for Interactive Explainability in Clinical Decision Support Systems
Related posts
BIOME: Evolving Google's Elephant-Goldfish Architecture for Production Multi-Agent Engineering
0dev.to OpenSource
Locally Uncensored AI Desktop App: Run DeepSeek v4.1 Flash Locally
0dev.to OpenSource
One Request, One Deadline: Inside RocketMQ-Rust's Timeout Handling
0dev.to Rust
2026 LLM API Token & Pricing Benchmark: How to Cut Your AI SaaS Inference Bill by 85%
0dev.to AI
AI Receptionist Business: What Vendors Charge and Where You Fit
0dev.to WebDev
EmuFive: running a PS5 emulator on a PS4
0dev.to Linux