AI & ML
Detect and Suppress: A Mechanistic Defense against Adversarial Patches in VLA Models
arXiv cs.RO0 views
arXiv:2610.03498v2 Announce Type: replace Abstract: Adversarial patches can disrupt Vision-Language-Action (VLA) models by manipulating visual observations, leading to failures in robot control. However, it remains poorly understood which internal mechanisms underlie these failures and how targeted interventions can mitigate them. In this work, we mechanistically analyze VLA representations using a sparse autoencoder (SAE) and identify a feature whose activation strongly correlates with the presence of an adversarial patch. Based on this analysis, we suppress the identified feature at inference time only when a linear probe detects an attack. This intervention improves robustness without the cost of fine-tuning the VLA. We evaluate our method against VLA adversarial patch attacks on LIBERO-10. Conditional intervention improves success rate under intermittent attacks, whereas continuously applying the same intervention substantially degrades policy performance. These results show that attack-related internal representations can provide useful targets for VLA adversarial defense and that controlling when to intervene is important for limiting disruption to nominal policy behavior.
Source:https://arxiv.org/abs/2610.03498PreviousCompressed delayed-information projection for underwater navigation under acoustic measurement latencyNextI3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation
Related posts
Sort and Filter a CSV in the Browser: Original Kept, Download Filtered
0dev.to
‘A perfect scientist, a perfect mum’: researchers mourn two biologists’ deaths in Spanish train crash
0Nature News

Apple says memory costs and Siri AI will weigh on holiday quarter profit margins
09to5Mac

Making Local LLMs Usable on 8GB GPUs
0HackerNoon

Educational Byte: What Are Synthetic Tokens in Crypto Networks?
0HackerNoon
Your AI Assistant Is Waiting Around - An AI Agent Goes to Work
0HackerNoon