Papers for
autonomous vehicle system designers
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Multimodal semantic encoding improves image reconstruction over noisy channels
Multimodal Semantic Communication using Shared and Unique Representation Decomposition
Abstract: Semantic communication (SemCom) has emerged as a promising paradigm for bandwidth-constrained mobile and vehicular networks. This paper proposes a unified representation learning framework for multimodal SemCom (MSC), which encodes heterogeneous data into a compact semantic space for efficient transmission and source recovery. The framework addresses the multimodal semantic representation gap, which arises when at least one modality contains semantic information that cannot be fully inferred from the other. To preserve this information for reconstruction, the framework decomposes each representation into shared and modality-specific components. We formulate a mutual information objective for source reconstruction, cross-modal alignment of the shared components, and decoupling of the shared and modality-specific components. To enhance transmission efficiency, we introduce a shared knowledge base implemented as a compact codebook of semantic vectors learned during training. The shared components are transmitted digitally as codebook indices, while the modality-specific components are sent in analog form. We apply knowledge distillation during training, using a pretrained vision foundation model to guide the learning of quantized shared features. On image--text pairs over additive white Gaussian noise (AWGN) and Extended Vehicular A (EVA) channels, the proposed framework improves image reconstruction over conventional separate source-channel coding (SSCC) and representative multimodal and unimodal SemCom systems. Further evaluations show gradual degradation under channel-estimation mismatch, complementary effects of alignment, decoupling, and knowledge distillation on the shared representation, and alignment of shared features across modalities with separation of the modality-specific features.
Embodied UAV agents share tokens to save energy and boost cooperation
An Embodied Multiagent Framework Based on Token Communications for Cooperative ISAC
Abstract: The emerging low-altitude economy demands unmanned aerial vehicle (UAV)-enabled integrated sensing and communication (ISAC) for reliable connectivity and environmental awareness. In particular, embodied UAV agents offer a promising means of supporting autonomous operations through a closed loop linking perception, decision-making, and physical actions. However, each UAV has access only to local observations, and effective cooperation requires exchanging local states and intentions. Directly sharing such information can incur substantial signaling overhead and hinder timely coordination in dynamic environments. To deal with this problem, this paper investigates a cooperative ISAC network of embodied UAV agents and formulates a joint token communications (TokCom) and physical control problem to minimize total propulsion energy subject to communication and sensing rate requirements. Then, we propose a state--intent TokCom (SI-TokCom) framework driven by multi-agent embodied policy learning. Specifically, separate pretrained codebooks enable compact exchanges of local states and intentions, while UAV agents jointly learn to select and compose tokens and determine physical actions based on local observations and received tokens. Simulation results show that SI-TokCom achieves 98.9\% and 99.1\% of the centralized baseline's communication and sensing rates, respectively. Compared with the local baseline, it improves the corresponding rates by 5.0\% and 43.6\%, respectively, with essentially unchanged propulsion energy. These results highlight the potential of TokCom for communication-efficient cooperation among embodied UAV agents in ISAC systems.
CoRF enables efficient radio spatial mapping across new scenes
CoRF: Cross-Scene RF Synthesis by Learning Propagation and Preserving Array Physics
Abstract: Existing radio-frequency (RF) neural fields fit each scene separately, making new-scene deployment measurement- and optimization-intensive. This work studies amortized cross-scene spatial spectrum synthesis, where a shared model learns propagation across scenes and instantiates an unseen scene from sparse target-scene measurements without scene-specific training. To achieve this, CoRF separates learned scene-dependent propagation from the known receiver-array observation model. An unordered set of spectrum-only references conditions a canonical anchor field, producing arrival directions and query-dependent component powers for each query. Analytic array physics maps these components to the receiver covariance and then to the spatial spectrum. This factorization keeps the pretrained propagation model frozen, enabling synthesis at arbitrary query locations after a single reference-conditioning pass. A necessary local reference-capacity bound and an error decomposition further characterize the formulation. Across 35 simulated scenes spanning seven categories, CoRF outperforms the strongest baseline by 7.09 dB PSNR on unseen variants of represented scene categories and by 6.97 dB on entirely unseen scene categories.