AI & ML
SACQ: Structure-Aware Codebook Quantization for Ultra-Low-Bit Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2610.41408v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models enable capable robot behavior, but their large memory footprint limits deployment on resource-constrained robotic platforms. Weight quantization is a natural remedy, yet post-training quantization (PTQ) recipes inherited from large language models degrade when applied to VLAs at ultra-low precision. Existing low-bit PTQ methods often fail to explicitly account for the structure of downstream operations and allocate precision without considering its effect on the policy actions. We introduce SACQ, an ultra- low-bit weight-only vector-codebook quantization framework for VLAs. SACQ combines (1) structure-aware codebook fitting with role-specific quadratic metrics that reflect input statistics and downstream sensitivity; (2) action-aware mixed-bit allocation based on the increase in final-action error as individual layers are compressed; and (3) two-stage post-quantization refinement that reassigns codeword indices with second-order error compensation and calibrates codebooks and row-group scales against the decoded action. Using GR00T N1.7, SACQ achieves 93.85% average success across four LIBERO suites at 1.5 bits per language/action weight while reducing model memory by 4.83x. With INT8 activation quantization and low-precision attention, it retains 93.55% success while running 1.51x faster than BF16. On SimplER, SACQ further achieves 63.76% and 52.27% success under Visual Matching and Variant Aggregation at 2 bits per language/action weight, compared to 58.90% and 53.45% for BF16, respectively.
Source:https://arxiv.org/abs/2610.41408PreviousMotorSense: A Video-EMG Dataset of Motoric Representations for Action UnderstandingNextFOCUS: First-Order Control Using Optimal Transport Supervision for Imitation from Observations
Related posts
Here’s who is falling in line for Trump’s “Super Intelligence” loyalty test
0MIT Technology Review
Google takes Dreambeans to India in bid to bring AI-generated personal stories to the masses
0TechCrunch

How to Choose an AI-Ready Workflow Platform
0dev.to

NYT Sues Brave, Calling Its Search API an 'Illicit Source.' 5 AI Firms Are Named Buyers
0dev.to
Using OpenAPI links to Connect a Response to the Next Request
0dev.to
Why Most Backtests Lie — and the 7 Checks That Catch Them
0dev.to