LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning
2026-07-03 • Computer Vision and Pattern Recognition
Computer Vision and Pattern Recognition
AI summaryⓘ
The authors developed LBTCap, a new method to describe changes between pairs of remote sensing images efficiently. Their design uses a special bilateral Transformer that processes both images together while keeping the model small and fast. Experiments show that LBTCap performs as well as bigger models but uses fewer parameters and runs faster, especially helpful when resources are limited. This approach helps make real-time monitoring applications more practical.
Remote Sensing Image Change CaptioningTransformerBilateral AttentionPaired ImagesEfficiencyInference SpeedChange DetectionNatural Language DescriptionModel ParametersGrouped-Query Attention
Authors
Licheng Zhang, Siew-Kei Lam, Naveed Akhtar
Abstract
Remote sensing image change captioning (RSICC) generates natural-language descriptions of semantic changes between paired remote sensing images (RSIs), supporting applications such as urban planning, disaster response, and environmental monitoring. Although recent methods achieve strong captioning accuracy, most overlook computational efficiency and inference speed, which are essential for real-time deployment in practice. To this end, we propose LBTCap, a lightweight RSICC framework built on a bilateral Transformer that jointly models pre- and post-change features for efficient processing of paired RSIs. Specifically, we introduce a bilateral attention mechanism for paired inputs: the two temporal images are projected into separate queries and keys by the same query and key matrices shared across the two images, the value is formed from their concatenation, and the two resulting attention maps are combined by a learnable, structurally bilateral weighting instead of a fixed subtraction. This design keeps both temporal branches explicit while remaining compact, and, together with a truncated backbone and grouped-query attention, LBTCap uses only 39.99M parameters, of which the change-aware encoder accounts for just 2.78M. Extensive experiments on two public RSICC datasets show that LBTCap matches or closely approaches the accuracy of state-of-the-art methods while using far fewer parameters and running at markedly higher inference speed, with the benefit of the bilateral formulation most pronounced in the low-resource setting, demonstrating a favorable accuracy-efficiency trade-off for practical RSICC.