ActTune: Action-Aware Precision and GPU Operating-Point Adaptation for Energy-Efficient Vision-Language-Action Inference
cs.RO, cs.AR
Submitted: 2026-10-06
Updated: 2026-10-06
License: http://creativecommons.org/licenses/by/4.0/
The gist: Vision-language-action (VLA) policies repeatedly invoke inference to control robots, making graphics processing unit (GPU) energy a recurring cost of task execution.
Terminology
Abstract
Vision-language-action (VLA) policies repeatedly invoke inference to control robots, making graphics processing unit (GPU) energy a recurring cost of task execution. Reducing energy per inference call, however, may not reduce energy per successful task if numerical errors increase failures or slower inference prolongs execution. We therefore target GPU energy per successful task while preserving task success and keeping the inference-latency increase within 10%. Our approach builds on two observations: quantization sensitivity varies across action classes, model layers, and weights versus activations; and numerical precision changes the workload, shifting favorable GPU operating points. We introduce ActTune, an action-aware framework that connects layer-wise precision allocation with workload-dependent GPU operating-point selection over requested frequency--power-cap pairs. A lightweight decision tree learns its splits and leaf precision configurations directly from configuration action errors, then selects precision before each policy call. The controller forecasts the next workload and applies the selected GPU operating point asynchronously using a lookup table calibrated under a latency budget. A shared resident quantized weight bank enables configuration switching without weight reconstruction or additional policy evaluations. On LIBERO, a benchmark for lifelong robot learning, ActTune improves mean task success by up to 2.3% relative to state of the art. Relative to the original BF16 implementations, it delivers up to 2.02 times faster inference and, with GPU operating-point adaptation, reduces energy per successful task by up to 76.8%.
Sources
- ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
- OpenVLA: An Open-Source Vision-Language-Action Model
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
- LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning
- Saliency-Aware Quantized Imitation Learning for Efficient Robotic Control
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models
- A Motion-Aware Vector Quantization Framework with Centroid Reuse for Efficient VLA Inference
- Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference
- DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
- The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study
- SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
- VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
- QVLA: Not All Channels Are Equal in Vision-Language-Action Model's Quantization
- EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models
- DyQ-VLA: Temporal-Dynamic-Aware Quantization for Embodied Vision-Language-Action Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies