AI & ML
Rhythmic-Semantic Co-Speech Gestures for Emotional Dialogue in Robots
arXiv cs.RO0 views
arXiv:2611.13472v1 Announce Type: new Abstract: Co-speech gestures can increase engagement and improve speech understanding. Yet, most data-driven robot systems generate either rhythmic beat-like motion or semantically meaningful iconic gestures, but not both. We present an emotion-aware rhythmic-semantic co-speech gesture system that generates iconic and beat behaviors in real time from text and the robot's internal emotional state. We formalize the task of beat-iconic gesture generation using emotion and propose lightweight models that predict iconic timing and intensity, then fill the remaining spans with emotion-conditioned beats at an appropriate intensity level. We train on the BEAT2 dataset and deploy the system on the social robot Haru. In an online user study with 60 participants, our method shows stronger speech-gesture alignment and is preferred over baseline methods.
Source：https://arxiv.org/abs/2611.13472PreviousDiscrete Model-Based Diffusion for Combinatorial Optimization in Multi-Robot Task AllocationNextExRL: Sample-Efficient Online Adaptation of Long-Chunk Policies via Execution Length Control
Related posts
HPE7-A11 Exam: A Design-Artifact Guide to Campus Access Architecture
0dev.to
Railway's Breach Cost $740,000 in Fraudulent AI Charges — and Up to 100,000 Workspaces May Have Leaked Secrets
0dev.to
Nod Reports 98% Agent Task Completion and 93.2% Long-Term Memory Recall in Tests
0dev.to
How to get business location data for a whole US state in bulk
0dev.to
OpenAI Cost Tracking Middleware: Build a Logging Wrapper That Shows Every Call's Price
0dev.to
3,500 laser-armed AI submarine drones patrol Norwegian salmon farms, killing sea lice and protecting 112 million fish
0Tom's Hardware