EchoChange: A Diffusion Language Model with Dual Pass Remasking for Factual Remote Sensing Disaster Change Captioning
2026-08-03 • Artificial Intelligence
Artificial Intelligence
AI summaryⓘ
The authors address the problem of describing changes in disaster images taken before and after an event. They note that existing methods write descriptions word-by-word, so an early mistake can cause many errors later. To fix this, they propose EchoChange, which rewrites the whole description multiple times, improving it step-by-step based on the images. Their approach works better than previous ones in tests on a disaster image captioning dataset.
remote sensingdisaster change captioningautoregressive decodingmasked-token denoisingmultimodal modelsdiffusion language modeliterative refinementsemantic metricsRSCC benchmark
Authors
Dongwei Sun, Bowen Yao, Yujie Zhang, Pei Liu, Jing Yao, Xiangyong Cao
Abstract
Bi-temporal remote-sensing disaster change captioning often needs to identify sparse and spatially localized changes across large pre- and post-event scenes and then translate them into coherent, factual descriptions. However, existing change captioning methods always follow an autoregressive decoding paradigm to generate the change description and thus an early misinterpretation of the changed object, event, or spatial relation becomes an irreversible premise for subsequent text, amplifying visual ambiguity into cascading factual errors. To address this limitation, we propose EchoChange, a multimodal discrete diffusion language model that formulates change captioning as iterative masked-token denoising rather than left-to-right generation. By repeatedly revising the entire caption while conditioning on the image pair, EchoChange can reconsider uncertain content and correct imperfect intermediate predictions. We further introduce draft-aware dual-pass training, a progressive masking curriculum, and confidence-guided remasking to align training with iterative inference. Extensive experiments on the RSCC benchmark show that EchoChange substantially outperforms both general-purpose and remote-sensing-specific baselines across lexical and semantic metrics. The EchoChange Project is at https://github.com/sundongwei/EchoChange_Project