Communication aware inference method cuts compute and latency in connected robotics

ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics

Robotics

Summary

Robots that follow spoken or written instructions need large AI models to understand and act. These models are often too big to run on the robot itself and must rely on a wireless connection to a powerful server. The authors found a way to reduce the amount of data sent over the wireless link by using the language part of the instruction to guess which parts of the image are important. This reduces computing work and delays while keeping the robot's success rate high, even with imperfect wireless signals.

What this means in practice

  • For robotics system engineers: Reduce latency and computing load by adapting vision-language processing to variable wireless channel capacity in robots controlled via natural language.
  • For wireless network designers: Design communication protocols that integrate language cues to optimize data transmission efficiency in robotic edge-cloud systems.

Authors

Boliang Liu, Wint Yi Poe, Jingyun Di, Riccardo Trivisonno, Giuseppe Caire

Abstract

Connected robotics is an emerging 6G application where mobile robots follow natural-language instructions to manipulate physical objects. The Vision-Language-Action (VLA) models that enable this are too large to run on the robot; a common trend is to offload inference to the cloud. The wireless link, however, limits how much sensing data the edge can transmit per control step. Two recent lines address this constraint: semantic communication codecs compress sensor data but require channel-specific retraining, and VLA token pruners select tokens from image but ignore the channel. Our insight is that the dense semantic information contained in the language already indicates which visual tokens matter. We propose ComVLA, a framework that uses this language guidance to adapt the VLA token budget to the channel capacity. Transmitting 32 tokens instead of 512 on the LIBERO benchmark, ComVLA cuts inference compute by 74% and inference latency by 22% versus the original OpenVLA-OFT baseline, at a cost of 1.5 pp in average task success (95.4% vs. 96.9%), and it stays within the capacity budget under Rayleigh and Rician fading. These results demonstrate that co-designing VLA inference and wireless communication is a practical direction for 6G-connected robotics.