Open Source
EgoTac: In-the-wild Tactile Prediction from Egocentric Vision
arXiv cs.RO0 views
arXiv:2608.15060v2 Announce Type: replace-cross Abstract: Touch is fundamental to dexterous manipulation, yet most egocentric human data increasingly used for robot learning lacks tactile information. Directly collecting large-scale tactile data is challenging due to sensor limitations, while human video data is abundant, contact-rich, and easily scalable. This motivates a natural question: can tactile signals be inferred purely from vision? To address this, we introduce EgoTac, a generalizable model that predicts rich tactile information directly from egocentric human videos. EgoTac is trained on a unified corpus of over 5.7M image-tactile pairs, covering both continuous force measurements and binary contacts. By learning from this diverse dataset, EgoTac captures nuanced touch dynamics across varied interactions. Experiments demonstrate strong performance: in-domain prediction achieves an average force error below 0.06N. On out-of-domain contact prediction benchmarks, EgoTac consistently outperforms the state-of-the-art contact estimator. It also captures the rise and fall patterns of real tactile data and enables zero-shot predictions on unconstrained real-world videos. Scaling analyses further reveal that both data diversity and volume improve performance steadily. Overall, EgoTac provides a scalable pathway to extract tactile priors from egocentric human videos, enabling broadly applicable tactile-aware robot learning. Related resources can be found at https://egotac.github.io/ .
Source:https://arxiv.org/abs/2608.15060PreviousNEXUS: Learning Safety Constraints and Action Models for Safe and Robust Embodied PlanningNextMetro-WM: Long-Horizon Latent Planning with Realisable Sub-Goals
Related posts

We got real Linux on iPhone!
0dev.to Linux
EveryOS - A desktop-style web GUI for Linux servers.
0dev.to Docker
Show HN: HN Atlas – Discover tools to better engage with Hacker News
0Hacker News Show
Show HN: TextoCAD – Text to editable CAD (STEP/STL), runs locally with your key
0Hacker News Show
Owen Sound: From Transit Budgets to Ride Targets
0dev.to JavaScript
ZeroBench: An Impossible Visual Benchmark
0Hacker News New