AI & ML
ObjDream: Guiding Vision-Language-Action Models with Object-Level Understanding and Future State Prediction
arXiv cs.RO0 views
arXiv:2610.20223v1 Announce Type: new Abstract: Vision-language-action (VLA) models have emerged as a powerful paradigm for robotic manipulation, enabling robots to generate actions from visual observations and language instructions. However, most existing VLA models still operate on image-level visual representations inherited from pretrained vision-language backbones, while lacking fine-grained object understanding for manipulation. As a result, their robustness can degrade under out-of-distribution object layouts, clutter, and background variations. To address these limitations, we introduce ObjDream, an object-centric VLA framework centered on object-level understanding and future object state prediction. ObjDream uses a spatio-temporal object encoder to organize visual observations into temporal object slots, where persistent object identity and dynamic object state are represented through separate channels. These structured object representations are inserted into the token sequence of the vision-language model (VLM), where identity-guided routing modulates VLM attention to the corresponding object tokens. In addition, an action-conditioned object dynamics module predicts compact future object states relevant to manipulation during training, explicitly supervising object state evolution under robot actions without requiring future prediction at inference. Experiments on LIBERO, LIBERO-Plus, and RoboTwin 2.0 show that ObjDream improves generalization under diverse distribution shifts and scene perturbations. Real-world robot experiments further demonstrate that ObjDream transfers to physical manipulation settings with novel object arrangements and background changes.
Source:https://arxiv.org/abs/2610.20223PreviousHow to Write Review Feedback a Coding Agent Can Turn Into a Verified FixNextSmart Fusion for Adaptive Visual-IMU Weighting in cuVSLAM Sparse Bundle Adjustment
Related posts
Locus Earth: Building an Open-Source 3D Globe That Runs Directly in Your Browser 🌍
0dev.to JavaScript
Ingeniería de Software TPV Local para Comercio de Moda y Calzado: Optimización de Inventario por Lotes y Matriz de Tallas (Vol. 41)
0dev.to Database
Ingeniería de Software TPV Local para Alimentación y Supermercados: Conexión a Balanzas Homologadas y Tickets con Trazabilidad (Vol. 42)
0dev.to Database
The Autonomous Edge — Issue #13: Cheaper Agents, Harder Governance (Week of November 2, 2026)
0dev.to AI

Plano Físico vs Plano Funcional en AWS Networking: cómo los arquitectos senior resuelven lo que otros no ven
0dev.to AWS
We built Origami Tutor: free paper-craft lessons you can turn and replay in 3D
0dev.to WebDev