AI & ML
MATE: Asynchronous Multi-Rate Diffusion Policy Composition
arXiv cs.RO0 views
arXiv:2607.17257v2 Announce Type: replace Abstract: Diffusion policies have shown strong potential for robotic imitation learning, and recent extensions incorporate additional modalities to improve manipulation performance. However, these modalities often differ not only in information content but also in sensing rates and inference latencies. Existing multimodal diffusion policies typically rely on synchronous fusion or manually designed multi-frequency architectures, which either slow down high-frequency feedback or limit extensibility to new modality combinations. We propose LAG-Fusion, a latency-aware guidance fusion framework for asynchronous multimodal diffusion policy composition. LAG-Fusion allows modality-specific policies to operate at their native inference rates and contribute denoising guidance whenever available. To make asynchronous composition consistent, we derive a reference-frame rebasing rule for diffusion variables under relative action representations, enabling delayed guidance to be aligned before fusion. We instantiate LAG-Fusion in contact-rich manipulation by composing a low-frequency vision policy with a high-frequency force policy. Experiments under heterogeneous modality latencies show that LAG-Fusion improves policy responsiveness and task performance over synchronous fusion and specially designed force-aware baselines.
Source:https://arxiv.org/abs/2607.17257PreviousEvoPlan: Evolutionary Neuro-Symbolic Robot Planning with Spatio-Temporal GuaranteesNextMulti-bounce Drum Roll with Optimized Active Tricks to Leverage Soft Embodiment
Related posts
P1.95 or P2.6: the pitch your camera picks before your client does
0dev.to
Building a Production AI Chatbot in Next.js: Architecture and Pitfalls
0dev.to
Home Assistant vs construir tu propia domótica en la nube: lo que aprendí haciendo la segunda
0dev.to
Hours of YouTube and 85 handtyped pages of notes on LLM Inference – Start here
0Hacker News
Humans will never again create a project like Wikipedia
0Hacker News
A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks
0arXiv cs.RO