Open Source
Context-Aware Generation and Modulation of Expressive Motion Behavior using Multimodal Foundation Models
arXiv cs.RO0 views
arXiv:2610.35615v1 Announce Type: new Abstract: Expressive robot motion positively impacts human-robot interaction by improving user engagement, likability, or task performance. We present a novel approach to automatically generate and modulate complex, expressive full-body gesture sequences from a multimodal (text, audio, video) context description. Based on a unified mathematical implementation of the Principles of Animation using Dynamic Movement Primitives, we use multimodal foundation models to generate such sequences along with parametric motion variations that are highly context-aware. This method extends the state of the art in terms of flexibility and generality by being interpretable, composable, and working across different robot morphologies. Moreover, we integrate the system into a continuous control framework and leverage knowledge distillation to learn a much smaller model, significantly improving token efficiency and system latency. Results from a user study with a human-like platform indicate that participants judged our system's motions to be better aligned with the interaction context than motions produced under a non-modulated or API-level condition. We also demonstrate how the system generates expressive motion for robots with different kinematics, showcasing its versatility. Paper webpage: https://gen-mod-expressive-motion-behavior.github.io/.
Source:https://arxiv.org/abs/2610.35615PreviousRoboDoctor: Training-Free Recursive Self-Improvement for Robot PoliciesNextRobot-Aligned 3D Gaussian Splatting for Precise Reaching with Wrist-Camera VLA Policies
Related posts
AI-Agent Pilot Checklist: 12 Questions to Answer Before You Start
0dev.to
How to Estimate AI-Agent ROI Without Overstating the Result
0dev.to
Vibe Kanban alternatives after the Bloop shutdown (2026)
0dev.to Productivity

config() Inside Your PHP Domain Is a Hidden Dependency. Inject Typed Settings Instead
0dev.to Testing
The Agent Isn't the Thing You Design
0dev.to
Psalm 7.0.0 [PHP static analysis tool by Vimeo]
0Hacker News New