AI & ML
Cleanly-DINO: Efficiently Learning Visual Task Spaces for Robotics
arXiv cs.RO0 views
arXiv:2611.20137v1 Announce Type: new Abstract: Learning manipulation tasks from few demonstrations requires abstractions that capture the changes relevant to task completion, such as object poses in rigid-body manipulation. However, tasks such as cleaning are defined by changes in visual state rather than object pose, making the choice of task representation less clear. In this work, we propose Cleanly-DINO to learn visual task spaces from few demonstrations. Given a mask of a task-relevant region and frozen ViT features, Cleanly-DINO fits a projection to isolate a task space and fit a progression metric to it. We train the model on diverse cleaning examples and evaluate its ability to localize incomplete task regions and transfer across visual domains. We also study its utility for robot learning by using it as an observation encoder and reward signal in a reinforcement learning setting. Finally, we deploy our fitted model within a real-world robotic wiping pipeline to evaluate its use in guiding task execution.
Source:https://arxiv.org/abs/2611.20137PreviousSAFER: Navigating the Exploration-Exploitation Dilemma in World-Model-Based Planning for Autonomous DrivingNextRoboKit: Accelerating Parallel Differentiable Optimization for Robot Learning
Related posts
Fluent English is not evidence of ASL understanding: lessons from building a video translator
0dev.to

Audit Trails and Explainability for Agentic AI in Code Events
0dev.to
By 3 p.m. the daily high was already final on 78% of days. In Madrid, 32% (49 airports, one year)
0dev.to

This smell startup says its AI nose is as good as a human’s
0MIT Technology Review

Debugging Claude Fable 5.2 Code Art: Truncated SVG, Broken Canvas, Working Render
0dev.to
Hydra · Coeziune OM–IA — the complete DOI registry (2026-11-18): 76 published works
0dev.to OpenSource