AI & ML
SACQ: Structure-Aware Codebook Quantization for Ultra-Low-Bit Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2610.41408v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models enable capable robot behavior, but their large memory footprint limits deployment on resource-constrained robotic platforms. Weight quantization is a natural remedy, yet post-training quantization (PTQ) recipes inherited from large language models degrade when applied to VLAs at ultra-low precision. Existing low-bit PTQ methods often fail to explicitly account for the structure of downstream operations and allocate precision without considering its effect on the policy actions. We introduce SACQ, an ultra- low-bit weight-only vector-codebook quantization framework for VLAs. SACQ combines (1) structure-aware codebook fitting with role-specific quadratic metrics that reflect input statistics and downstream sensitivity; (2) action-aware mixed-bit allocation based on the increase in final-action error as individual layers are compressed; and (3) two-stage post-quantization refinement that reassigns codeword indices with second-order error compensation and calibrates codebooks and row-group scales against the decoded action. Using GR00T N1.7, SACQ achieves 93.85% average success across four LIBERO suites at 1.5 bits per language/action weight while reducing model memory by 4.83x. With INT8 activation quantization and low-precision attention, it retains 93.55% success while running 1.51x faster than BF16. On SimplER, SACQ further achieves 63.76% and 52.27% success under Visual Matching and Variant Aggregation at 2 bits per language/action weight, compared to 58.90% and 53.45% for BF16, respectively.
Source:https://arxiv.org/abs/2610.41408PreviousMotorSense: A Video-EMG Dataset of Motoric Representations for Action UnderstandingNextFOCUS: First-Order Control Using Optimal Transport Supervision for Imitation from Observations
Related posts

OpenAI introduces program to reduce AI data center energy demand during peak hours — company testing Grid Protectors Program system in Georgia
0Tom's Hardware
Google confirms something was draining Pixel Watch batteries, fix rolling out
09to5Google
New York City’s Mamdani criticizes Madison Square Garden owner over surveillance tech
0TechCrunch
When growth stalls, should you double down on higher-revenue customers?
0dev.to
Which process to automate first with AI: an 8-question checklist for businesses
0dev.to
Flaschendrehen & Wahrheit oder Pflicht fur Hauspartys: Wie wir Wobbly Bottle gebaut haben
0dev.to