Frontend
ReactWorld: Structuring Interaction Responses for Embodied Video Generation
arXiv cs.RO0 views
arXiv:2611.06120v1 Announce Type: cross Abstract: Embodied video world models predict scene changes caused by robot actions, yet generated object responses may remain inconsistent with task intent and contact dynamics. Critical responses in embodied scenes often concentrate in local regions and specific time intervals. Inspired by chain-of-thought reasoning, we introduce ReactWorld, an embodied video generation model guided by structured interaction anticipation. In the generation backbone's feature space, an interaction response field predictor anticipates how the interaction will unfold, explicitly describing participant roles, future motion response intensity, and local motion changes. A response feedback adapter forms increments to object features from the difference between the object branch's outputs with predicted and zeroed local dynamics inputs. It also converts predicted displacements into positional biases for temporal attention. These two mechanisms guide object feature updates and information retrieval across frames, respectively. Through interaction anticipation and generative feedback, ReactWorld achieves an average score of 77.51 on RBench, outperforming PhysisForcing by 3.29 points with improvements in all nine categories. On EZS-Bench, it achieves a Domain score of 86.98 and an average score of 81.87.
Source:https://arxiv.org/abs/2611.06120PreviousWayPOP: A Panoramic Open-Set Panoptic Tracking BenchmarkNextInteractive World Simulation with Cosmos for Physical AI
Related posts
Element-wise Convergence Behavior of Subspace Iteration
0arXiv cs.NA
Dimensionally absolutely stable but non-diagonalizable $T$-meshes
0arXiv cs.NA
Prediction-Intervention Games and Invariant Sets
0arXiv stat.ML
Backdoor Attacks under Lossy Compression: From Failure to Reactivation and Adaptation
0arXiv cs.CR
How Freelancers Can Choose an AI Writing and Editing Assistant Without Overpaying
0dev.to AI

easily understand flexbox
0dev.to CSS