Papers for

remote sensing teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

MaskSCD improves land cover change maps from satellite images

MaskSCD: Bitemporal Mask Classification for Semantic Change Detection in Remote Sensing Images

Abstract: Semantic change detection (SCD) identifies where the land surface has changed and which land-cover transition has taken place. Most deep SCD networks predict the change map and the land-cover map of each date with separate per-pixel decoders. These outputs need not agree, so a pixel can be labeled as changed although it has the same class at both dates, and per-pixel decisions fragment objects. We present MaskSCD, which formulates SCD as the mask classification of a bitemporal label-pair image. Each bitemporal segment, a region of constant land-cover class pair, is predicted as one mask shared by both dates together with one class per date, and the change map is derived from the predicted class pair. This formulation keeps the change and semantic maps consistent and the label space linear in the number of classes. A bitemporal masked-attention transformer decoder implements it by reading each segment in both images and relating the two readings, and a bitemporal fusion pyramid provides per-date and change-aware features. MaskSCD is evaluated on SECOND, Landsat-SCD and Hi-UCD, which span 0.1 to 30 m resolution and four to nine land-cover classes, against fourteen recent SCD models re-trained under one protocol. MaskSCD achieves the best separated kappa, semantic change $F_1$ and transition $F_1$ on all three datasets and exceeds the strongest competitor by about five points in mean separated kappa. It produces no contradictory change pixels, which account for nearly 30% of the predicted change of some multi-task networks. The code is available at https://github.com/EricYu97/MaskSCD.

Fri 13 NovComputer Vision and Pattern Recognition
The gist
Semantic change detection finds where and how land cover has changed over time using satellite images. The authors introduce MaskSCD, a new method that looks at regions across two images taken at different times and classifies them together instead of pixel by pixel. This approach ensures that detected changes match actual land-cover transitions and avoids conflicting labels. Tested on three datasets with different resolutions, MaskSCD showed better accuracy than recent methods and eliminated contradictory change predictions.
Open → 2611.18350v1

Vision transformers improve multi-channel image understanding with token decorrelation

Disentangling Channel Semantics in Vision Transformers via Token Decorrelation and Composition-Aware Modulation

Abstract: Multi-channel images encode heterogeneous channel semantics aligned over a shared spatial structure, which requires models to jointly capture globally shared structure and channel-specific variations. Recent multi-channel Vision Transformers attempt to address this challenge by augmenting the [CLS] token with memory tokens to organize multi-channel representations under varying channel compositions. However, we find that these context tokens collapse onto a few dominant channels under high inter-channel redundancy, producing redundant representations and a biased global summary that fails to reliably support composition-aware channel interpretation. We propose MuCa-ViT (Multi-Channel Composition-Aware Vision Transformer), a unified framework that addresses these limitations through two coupled mechanisms. Factorial Token Learning (FTL) enforces token-level decorrelation among context tokens, encouraging the [CLS] token to capture globally shared semantics while memory tokens preserve complementary channel-specific cues. Channel Composition-Aware Modulation (CAM) uses the FTL-refined [CLS] as a semantic anchor to generate sample-wise modulation signals, which enable composition-aware interpretation of channels within a unified backbone rather than relying on static channel embeddings. Experiments on JUMP-CP, CHAMMI, and So2Sat show that MuCa-ViT outperforms prior multi-channel ViTs across all three benchmarks, and the magnitude of improvement aligns with the inter-channel redundancy of each dataset ($ρ\in [0.19, 0.77]$), validating the diagnostic analysis that motivates our design. Our code is available at https://github.com/kimdanni/MuCa-ViT .

Sat 7 NovComputer Vision and Pattern Recognition
The gist
Multi-channel images contain different types of information that are aligned over the same space, so models need to understand both shared and unique parts correctly. The authors found that existing vision transformers tend to overly focus on some channels and ignore others, leading to poor summaries. They created a new method called MuCa-ViT that helps the model keep tokens independent and adjust channel interpretation dynamically. This approach performs better on several multi-channel image datasets, especially when channels have overlapping information.
Open → 2611.10497v1

Geospatial models pretrained on very high resolution images improve remote sensing tasks

When GeoFMs Meet VHR: Benchmarking Foundation Models on Very High Resolution Earth Observation Imagery

Abstract: Geospatial foundation models are a widely adopted starting point for remote sensing tasks. Most are pretrained on Sentinel-1/2 and Landsat imagery at a ground sampling distance (GSD) of 10m or coarser. Many applications instead rely on very high resolution (VHR) imagery, where individual buildings, roads, and amenities are resolved. We study which pretraining regimes transfer well to this scale. We introduce VHR-Bench, a benchmark suite of ten datasets at 1.5m GSD or finer spanning five task families, eight application domains, and both satellite and aerial platforms. We evaluate twelve encoders in three pretraining tiers with frozen backbones at two training-data fractions. We find that both pretraining on large natural-image collections and VHR-specific pretraining transfer effectively to VHR tasks, with complementary strengths. SkySense leads when labels are scarce; at the full label fraction the web-pretrained DINOv3 ViT-L edges ahead, with the two close together there. Encoders pretrained only on Sentinel-scale imagery transfer least well under RGB input. Guided by these complementary results, we continue the self-supervised pretraining of DINOv3 ViT-L on 1.02 million held-out VHR tiles and evaluate the resulting encoder without changing the downstream protocol. The continued model gives a clear improvement over the released backbone when labels are scarce and a modest one at the full fraction, at no increase in inference parameters or compute. These findings support a generalize-then-specialize strategy: already strong, broad natural-image pretraining can be further improved by a short VHR continuation stage while preserving its general visual features.

Thu 5 NovComputer Vision and Pattern Recognition
The gist
Satellite images are used to study the Earth, but most computer models are trained on lower-resolution images that blur important details. The authors checked how well different pretrained models work on very high resolution images that show details like buildings and roads. They found some models trained on general photos and some on high-res images each have strengths. By continuing to train a strong model on high-res data, they improved its performance on tasks with fewer labels. This shows starting with a broad training and then specializing on high-resolution images helps tackle detailed Earth observation tasks.
Open → 2611.08003v1

ProtoFusion uses protocols to improve infrared and visible image fusion

ProtoFusion: Protocol-Guided Prompt Refinement for Generative Infrared and Visible Image Fusion

Abstract: Infrared and visible image fusion integrates complementary information from both modalities to provide a more comprehensive representation of the scene. We propose ProtoFusion, a protocol-guided generative framework for infrared and visible image fusion. Instead of relying on fixed fusion operators, hand-crafted objectives, or manually specified one-shot prompts, ProtoFusion formulates fusion as protocol-constrained generation. It represents fusion intent with a structured protocol, consisting of environment state cards, grounding principles, and a style profile, which explicitly specifies which evidence should be preserved or suppressed and which properties the fused result should satisfy. To optimize this protocol, we introduce protocol-guided prompt refinement, a closed-loop learning framework that iteratively performs generation, evaluation, and revision under multimodal evidence. Once learned, the optimized protocol is fixed at inference time and directly guides fusion generation. To address residual source inconsistencies, we further incorporate structured belief construction, which organizes modality reliability, scene evidence, and cross-modal conflicts into a structured representation for conservative correction after generation. Extensive experiments on standard benchmarks show that ProtoFusion improves quantitative performance, achieves favorable results in aesthetic evaluation, and produces visually coherent fusion outputs. Project Page: {https://erfect2020.github.io/ProtoFusion/}.

Mon 2 NovComputer Vision and Pattern Recognition
The gist
Combining images from infrared and visible cameras can help us see more details in a scene. The authors developed a new method called ProtoFusion that guides this combination process using detailed instructions, called protocols, rather than fixed rules. These protocols specify what information should be kept or hidden and what qualities the final image should have. The method also learns to refine these protocols over time to produce better results, and it carefully fixes inconsistencies afterward. Their tests show that ProtoFusion creates clearer and more visually appealing fused images compared to existing methods.
Open → 2611.02877v1

Multimodal prompts improve tracking in hyperspectral videos

Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking

Abstract: Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as camouflage and low illumination. However, limited hyperspectral annotations and the large RGB-hyperspectral domain gap hinder the direct use of modern temporally pretrained RGB trackers. We propose SProTrack, a multimodal framework that transfers temporal knowledge from pretrained RGB trackers to the hyperspectral domain through latent spectral prompting. The key idea is to decouple temporal modeling from spectral adaptation, allowing temporal dynamics to be inherited from RGB foundation models while hyperspectral information is learned from unlabeled data in a self-supervised manner. Unlike band-selection methods that discard most spectral information or prompt-based approaches that rely on local-search crops, SProTrack learns a global, scene-level spectral representation from the full hyperspectral frame using an autoencoder. This latent representation is used to guide spectral prompt extraction while a pretrained RGB tracker preserves strong temporal modeling on RGB-compatible inputs. By encoding spectral-spatial structure into compact latent prompts, SProTrack bridges the RGB-hyperspectral modality gap without extensive retraining or dense supervision. Experiments on HOT2020 and HOT2023 demonstrate that SProTrack achieves the best overall performance, with strong results across all spectral domains.

Mon 2 NovComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Tracking objects in videos can be harder when colors look the same or lighting is poor, but hyperspectral videos capture many different wavelengths of light, giving more detailed information. This paper presents a new method that uses knowledge from tracking models trained on normal color videos to help track objects in hyperspectral videos. It works by creating a compact representation of the spectral information from the whole scene and combining it with a pretrained tracker that understands movement over time. The method improves tracking accuracy on challenging datasets without needing many labeled examples.
Open → 2611.02512v1

LoCA improves multimodal geographic location encoding for Earth data

LoCA: Enabling Multi-Modality in Geospatial Location Encoders

Abstract: Location encoders map geographic coordinates to high-dimensional descriptors through contrastive alignment with paired Earth Observation imagery. We prove that this construction is structurally limited: any Lipschitz location encoder produces an output of intrinsic dimension at most 2, regardless of architecture or bandwidth, which forces the contrastive loss to strictly exceed its asymptotic optimum. Empirically, joint training also collapses the encoder's embedding covariance to low rank. Although dimension-limited, current location encoders sidestep this spectral collapse by training against a frozen image encoder, which we reinterpret as a covariance regularizer that supplies a high-rank target for the location encoder to fold onto. However, extending this approach to multimodal inputs is challenging, as location encoders should simultaneously map a single location to multiple, potentially incompatible, descriptors. We identify two requirements a regularizer must satisfy for location encoding in multimodal regimes: co-alignment across modalities, since adapters alone cannot align independently pretrained encoders; and high effective rank, since the location encoder inherits its target's spectrum. We propose LoCA (Location Contrastive Alignment), a two-stage pipeline that satisfies both. Stage 1 jointly trains Sentinel-1 and Sentinel-2 encoders with contrastive learning, producing a co-aligned, high-rank multimodal target. Stage 2 freezes the image encoders and trains a location and a tabular metadata encoder as projection adapters with multi-view contrastive learning. Against five state-of-the-art encoders on 17 tasks ranging from land cover and wildfire forecasting to geophysical, socio-economic, biodiversity and climate applications, LoCA achieves the most task wins, is the only model to outperform every other on a majority of tasks, and wins 68.8% of all per-task comparisons.

Fri 23 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Mapping geographic locations to useful digital descriptions is important for many Earth science tasks. The authors show that current methods have a mathematical limit that reduces the diversity of location encodings. They propose LoCA, a two-step process that aligns satellite image data from different sources and produces richer, multimodal location representations. Their method improves performance across many tasks like wildfire forecasting and biodiversity assessment compared to previous encoders.
Open → 2610.32894v1

Multispectral detector improves object recognition with rotation consistency

S$^3$E-Det: A Strict Spatial-Spectral Equivariant Detector for Multispectral Object Detection

Abstract: Multispectral object detection requires detectors to exploit material-dependent spectral responses while maintaining consistent localization under geometric variations. Existing MOD detectors learn discriminative spectral representations, yet lack a unified mechanism that preserves spectral order, adapts spectral-context fusion across pyramid levels, and regulates geometric responses under rotation. To address these limitations, we propose S$^3$E-Det, a strict spatial-spectral equivariant detector that couples ordered spectral modeling with transformation-consistent prediction. Spectral Order-aware Sampling Calibration (SOSC) imposes local order constraints on input-derived spectral features through first-order variation, while Common-Differential Equivariant Fusion (CDEF) adapts spectral-context aggregation across pyramid levels. A compact Geometric Alignment Head (GAH) reconciles invariant and equivariant output properties within a unified prediction stage. Across MODA, HOD3K, and DroneVehicle, S$^3$E-Det combines high detection accuracy with a compact parameter footprint and reduced rotation-induced variation. Code is available at https://github.com/Riiluo/S3E-Det.

Tue 20 OctComputer Vision and Pattern Recognition
The gist
Detecting objects using multispectral images is tricky because the detector must recognize materials by their color patterns and locate objects accurately even when the view changes. The authors introduce a new detector called S3E-Det that keeps the order of spectral data and ensures predictions stay consistent when images rotate. Their method uses special techniques to combine spectral information across image scales and aligns geometric features for better accuracy. They tested it on several datasets and found it detects objects well with fewer errors caused by rotation.
Open → 2610.27882v1

Hyperspectral image reconstruction improved by adaptive manifold learning

Manifold Prior Guided Deep Unfolding for Hyperspectral Image Reconstruction

Abstract: Hyperspectral Image (HSI) reconstruction has made substantial progress with the deep unfolding framework by decomposing the problem into a projection module and a denoiser module. Nevertheless, existing methods still exhibit limitations of insufficient matching with HSI data. The issues lie in two aspects: 1) the data-consistency projection module applies a fixed gradient descent step while ignoring the spectral content adaptivity of HSI; 2) the denoiser module either suffers from high computational complexity or is limited to the local receptive field, failing to efficiently capture the global spatial-spectral dependencies. In this paper, we propose a deep unfolding framework centered on a two-stage manifold learning strategy to obtain a degradation-free structural prior, which is then strategically injected into both the projection and denoiser modules. In the data-consistency projection, a prior-guided spectral weight mechanism is introduced to adaptively modulate the weight of spectral band. In the denoiser module, a manifold-guided Mamba is proposed to achieve the structure-aware extraction of spatial-spectral features through prior modulation. Quantitative and visual comparisons on synthetic and real-world datasets show that the proposed method significantly outperforms existing state-of-the-art approaches, while maintaining the structural interpretability of the unfolding framework. The code is available at https://github.com/SqLiu67/MPG-DU.

Tue 20 OctComputer Vision and Pattern Recognition
The gist
Hyperspectral images contain lots of color and light information that helps in many fields, but reconstructing them well can be hard. The authors found current methods struggle to adapt to the different spectral bands and to capture global spatial and spectral relationships effectively. They introduced a new approach that learns the underlying structure of the data and uses that knowledge to guide the reconstruction process in two key steps, improving accuracy and efficiency. Their method works better than existing ones on both simulated and real images.
Open → 2610.27874v1

Improving object detection by selectively fusing radar and optical channels

Revealing Inter-Channel Modality Discriminability: Channel Selective Interaction Fusion Network for Optical-SAR Object Detection

Abstract: Synthetic aperture radar (SAR) and optical imagery provide complementary structural and appearance information for remote sensing object detection. However, substantial cross-modal discrepancies and indiscriminate channel interaction inevitably introduce redundant or conflicting features. Since different feature channels encode heterogeneous semantic information and contribute unequally to cross-modal fusion, selectively highlighting task-relevant channels while suppressing redundant ones is essential. To address this issue, we propose the Channel Selective Interaction Fusion Network (CSIF-Net), which performs selective channel-level cross-modal interaction. CSIF-Net first employs a frequency decomposition module to construct frequency-aware SAR inputs, facilitating the separation of structural information from noise-related responses. It then models cross-modal channel relationships through a cross-attention channel selection module and dynamically partitions the features into shared and modality-specific components. Finally, a dual-branch fusion module performs cross-modal interaction and channel realignment for shared features while independently enhancing SAR-specific features, thereby exploiting complementary information and suppressing modality interference. Extensive experiments on the OGSOD 1.0 and M4-SAR datasets demonstrate that CSIF-Net achieves state-of-the-art performance in both horizontal and oriented object detection, surpassing the existing methods by 4.01% and 3.18% gains, respectively.

Tue 20 OctComputer Vision and Pattern RecognitionMultimedia
The gist
Detecting objects from satellite images can be hard because radar (SAR) and optical images show different kinds of information that don’t always match well. The authors created a new method that carefully picks and combines the most useful parts from each type of image to improve detection. Their method separates common features from unique ones in each image type and reduces confusing or irrelevant data. When tested, this approach was better at finding objects than earlier methods.
Open → 2610.27757v1

Stochastic modeling improves hyperspectral image classification accuracy

See the Future, Classify the Present: Stochastic Latent World Modeling for Hyperspectral Images

Abstract: Hyperspectral image classification (HSIC) relies on static spatial-spectral representations learned from labeled samples, limiting its ability to model structured dependencies in the latent representation space. To address this limitation, this work proposes Stochastic Latent World Modeling (LWM), a trajectory-based representation-learning framework that enriches classification through stochastic latent-state prediction. Given a hyperspectral patch, LWM tokenizes and encodes spectral and spatial information separately using dedicated transformer branches, then fuses their outputs into a unified representation. This representation is further organized into an environment state that captures center, neighborhood, spectral, and global contextual information. A stochastic latent transition module then predicts multiple future latent states through Gaussian parameterization and reparameterization, with recurrent refinement used to model dependencies across successive states. The resulting latent trajectory is adaptively aggregated by a rollout planner to construct a planned representation, which is integrated with the base representation for final classification. By extending static spatial-spectral encoding with stochastic multi-step latent-state modeling, LWM enables the classifier to exploit structured dependencies in the representation space and provides richer features for HSIC. Across five benchmark datasets, LWM achieves overall accuracies ranging from 89.21% to 99.52%, demonstrating consistent classification performance under limited-label settings.

Mon 19 OctComputer Vision and Pattern Recognition
The gist
Hyperspectral images capture detailed color information beyond what our eyes see, but classifying these images accurately is challenging because current methods look at static snapshots of data. The authors created a new method that predicts possible future states of image data, helping computers understand the structure and context better. This approach mixes spatial and color information with a way to imagine how that info changes, improving classification even with limited training data. Their tests show it works well on many standard image datasets.
Open → 2610.25781v1

Deficit-driven method builds large balanced SAR optical Earth dataset

Deficit-Driven Stratified Acquisition for Building STRATA-S12: An Open SAR-Optical Corpus for Self-Supervised Learning

Abstract: Building a co-registered SAR-optical corpus for self-supervised Earth Observation is above all an acquisition problem, yet the main multi-modal datasets are collected opportunistically, with no per-stratum quota control and no mechanism against the geographic dropout that non-uniform cloud cover leaves behind. We present Deficit-Driven Stratified Acquisition (DDSA), an algorithm that treats building a co-registered Sentinel-1/Sentinel-2 corpus as a constrained maximum-coverage problem over a hemisphere-corrected (class x season x region) stratification, enforces strict temporal pairing and a multi-stage quality gate, and closes the loop during acquisition with a human-in-the-loop deficit-repair stage. Measured on its own product, the algorithm yields three results a single-pass acquisition cannot report. Deficit-driven ordering makes a partial run a covering one: it holds every one of the 192 strata populated from the first few percent of the budget, where an abundance-first order leaves most strata empty until the end. Whether a failed attempt can be recovered depends on the temporal persistence of its cause, not the kind of defect: geometric failures such as nodata are among the most repairable (eta = 41.4%) while cloud is among the least (eta = 18.8%), because a cloudy location is cloudy on most dates of its season. The repair loop supplies 39.5% of the released pairs at no measurable quality cost, with 89.8% surviving manual review. The quality guarantee has a price: 2,928,370 acquisition attempts produced 740,746 released pairs. We release the corpus, STRATA-S12, with STAC/PDS4-aligned FAIR sidecars, and a pre-registered linear-probe check confirms it is fit for self-supervised pre-training. A metadata-level coverage comparison against SSL4EO-S12 and SEN12MS situates the corpus over a shared frame; systematic cross-corpus and cross-method comparison is left to follow-up work.

Tue 13 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Earth observation images often come from satellites using different sensors like radar (SAR) or optical cameras, but putting these together as matching pairs can be tricky, especially when clouds block views. The authors developed a method called Deficit-Driven Stratified Acquisition (DDSA) that carefully plans and collects matched image pairs across different regions, seasons, and land types to make sure none are left out. Their method checks image quality, retries when problems occur, and uses human input to fix gaps. This process created a new large dataset called STRATA-S12, which is ready to help train machine-learning models that learn from both radar and optical images.
Open → 2610.17680v1

Foundation model separates learning for radar and optical images

SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models

Abstract: Synthetic aperture radar (SAR) and electro-optical (EO) imagery provide complementary observations: SAR enables day-and-night, weather-resilient sensing, whereas EO provides rich appearance and fine-grained semantic cues. We introduce SAREO-FM, which avoids forcing a single token stream to serve two distinct roles: modality tokens preserve how each sensor observes the scene through masked reconstruction, while learnable semantic queries capture what the scene contains under guidance from a pretrained vision foundation model (VFM). By jointly encoding these queries with SAR and EO tokens, the queries acquire modality-grounded semantic context, while the modality-token outputs remain the explicit targets of masked reconstruction. This design assigns semantic and reconstruction supervision to separate token streams while preserving their interaction within the shared encoder. Pretrained on the million-scale SAR-1M corpus, SAREO-FM achieves strong unimodal transfer for both SAR-only and EO-only inputs, while delivering substantial gains from joint SAR--EO observations on tasks that benefit from complementary sensing.

Wed 7 OctComputer Vision and Pattern Recognition
The gist
Radar and optical cameras see the world in very different ways — radar works anytime and in any weather, while optical cameras capture fine details and colors. The paper presents a new method called SAREO-FM that treats radar and optical data separately but learns to combine their strengths. It uses separate pieces inside a model for understanding what is in the scene and for reconstructing the sensor signals, which helps the model learn better. This method improves how computers understand images from each sensor alone and works even better when combining both together.
Open → 2610.09317v1

Anaximander simplifies running geospatial deep learning models everywhere

Anaximander: Interactively Running Geospatial Deep Learning Models on Any Compute Backend

Abstract: Applying deep learning models to satellite imagery from within geographic information systems (GIS) remains high-friction for remote sensing practitioners. Models arrive in incompatible formats and target different compute environments, from local workstations to serverless cloud services. As a result, every evaluation demands custom deployment, tiling, and georeferencing code before a single prediction reaches the analyst's map. This friction discourages systematic comparison in a domain where model choice directly affects operational outcomes such as field delineation, crop monitoring, and disaster response. We present Anaximander, an open-source system that unifies model source and compute location choice behind one interactive interface. The system's backend is an inference server that loads models from multiple commonly-used sources and serves them on any accessible compute backend. The server provides session management and model caching, and streams results back per tile. The backend is paired with a QGIS plugin that drives tiling, result reassembly, georeferencing, and real-time per-tile status visualization. An additional user-interface path injects layer legends as prompts into vision-language models. We demonstrate the system in a code-free side-by-side comparison of three heterogeneous models on an agricultural field delineation task: gpt-image-1 via a cloud API, Segment Anything Model 3 (SAM3) on a remote GPU, and DelineateAnything on a local CPU. The inference backend and protocol are open-source and available at https://github.com/microsoft/nxmndr.

Tue 6 OctComputer Vision and Pattern Recognition
The gist
It is hard to use different deep learning models on satellite images because each one works in different ways and on different computers. The authors built Anaximander, a free tool that lets people run many models on any computer, from local machines to cloud servers, using one easy interface. It connects to a popular mapping program to handle cutting images into pieces and putting results back together on maps, showing status in real time. They showed it works by comparing three different models on a farming task without writing code. This tool helps experts quickly try out different methods on satellite images without confusing setup.
Open → 2610.09085v1

Convolutional networks outperform attention models for ice sheet images

Why Convolution Still Matters: Evaluating Inductive Biases in Cryospheric Image Classification

Abstract: Recent advances in attention-based deep learning have motivated their adoption for remote sensing image classification; however, their benefits for cryospheric imagery, where surface states are dominated by fine-grained textures and class imbalance, remain unclear. In this work, we revisit a benchmark Greenland Ice Sheet image dataset, previously shown to favor convolutional neural networks (CNNs), to examine whether modern attention-based and hybrid architectures improve class-wise reliability. We conduct a controlled comparison between a classical CNN (AlexNet), a modern CNN (ConvNeXt-Tiny), a pure attention-based model (Swin-Tiny), and a hybrid convolution-attention model (CoAtNet-0) under identical training and evaluation protocols. Results show that AlexNet achieves the highest accuracy and the strongest balanced performance as measured by macro-averaged F1, while ConvNeXt-Tiny exhibits the highest macro-averaged AUC, indicating strong class separability but less consistent final decision quality. Class-wise analysis reveals that hybrid architectures improve recall for rare and structurally distinct surface classes, whereas convolutional models remain more reliable for texture-dominated categories. These findings highlight the importance of aligning architectural inductive bias with cryospheric data characteristics and suggest that increased model complexity does not necessarily translate to improved reliability for ice-sheet surface classification.

Fri 2 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Classifying images of ice sheet surfaces is hard because many surface types look similar and some types are rare. The authors compared different computer models for identifying these surfaces, including older convolutional neural networks (CNNs), newer attention-based models, and hybrids. They found that traditional CNNs were generally more accurate and consistent, especially for surface textures, while hybrid models better detected rare ice types. This suggests simpler models with built-in assumptions about image patterns still work best for this kind of icy landscape data.
Open → 2610.04073v1

Hyperspectral image upscaling works well on unseen sensors fast

Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators

Abstract: Achieving cross-sensor generalization and arbitrary-scale reconstruction with a single model remains challenging in hyperspectral super-resolution (HSR). Although recent methods support arbitrary-scale reconstruction, applying them to new sensors or scales beyond the training range often requires additional data and computation to maintain reconstruction quality. To address these challenges, we propose OmniHSR, which predicts band-shared spatial operators rather than spectral values. Cross-Spectral Mapping (CSM) resamples inputs with any number of bands to fixed reference positions and predicts local operators with Gaussian supports. Continuous Operator-Field Reconstruction (COFR) composes these operators into a continuous field and applies them to all original bands for arbitrary-scale reconstruction. Experiments demonstrate that operator prediction outperforms direct spectral-value prediction on all seven datasets. Trained solely on ARAD with only 0.538M parameters, OmniHSR outperforms all directly transferred baselines on six unseen datasets without target-domain training data or adaptation. Across twelve upsampling factors from $\times2$ to $\times48$, it improves average PSNR on Pavia U and Chikusei by 0.55 dB over the strongest baseline. It also surpasses baselines trained from scratch or adapted on the target sensor and achieves up to $36\times$ faster inference. Our code will be publicly released soon.

Wed 30 SeptComputer Vision and Pattern Recognition
The gist
Hyperspectral images capture many colors beyond normal cameras but are often low resolution. Improving their resolution usually requires specific models trained for each camera and scale. The authors created a single model that learns general patterns to enhance images from many sensors and scales without retraining. Their method predicts spatial operators instead of direct color values, allowing smoother and faster image enhancement. Tests show it works better and faster on new cameras than previous approaches.
Open → 2609.39926v1

Spectral super-resolution improves satellite image detail and color accuracy

Spectral Super-Resolution using Spatial-Spectral Residual Operator Networks

Abstract: Spectral super-resolution of multispectral satellite images can enable high temporal- and spatial-resolution hyperspectral satellite imagery at a modest cost, significantly increasing the applicability of hyperspectral remote sensing. This task is inherently ill-posed, making it well-suited for deep learning-based methods. In this study, the spectral super-resolution task is framed as an operator learning problem, and SSRON is proposed as a Deep Operator Network that effectively learns function-to-function mappings from downsampled spectra to continuous spectra. The model is trained to super-resolve Sentinel-2A-like multispectral imagery to EMIT images. Compared to baseline models, SSRON achieves superior performance across all metrics. The model also demonstrates zero-shot spectral super-resolution capability by predicting bands unseen during training. Furthermore, its continuous-output formulation suggests the potential to estimate spectra at finer wavelength intervals than the native sensor. These results suggest the potential of SSRON and establishes operator learning as a promising direction for spectral super-resolution.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Satellite images often capture limited colors or wavelengths, making it hard to see detailed information about the land or environment. The authors present a new deep learning method called SSRON that can take these simpler images and predict more detailed color information, similar to higher-quality hyperspectral images. This method is especially good because it learns continuous spectral information and can guess details even for colors it hasn't seen before. This could help scientists and businesses get better insights from satellite imagery without needing expensive sensors.
Open → 2609.35410v1

Preference guidance improves open-vocabulary image segmentation in new domains

Preference-Guided Adaptation for Open-Vocabulary Semantic Segmentation via Prompt Disagreement

Abstract: Open-vocabulary semantic segmentation (OVSS) enables pixel-level prediction over arbitrary text-specified vocabularies and has shown strong generalization on common benchmarks. However, OVSS performance often degrades in specialized domains such as medical imaging, remote sensing, and industrial inspection, where dense pixel-level masks for adaptation are costly to obtain and require domain-specific expertise. We propose a preference-guided adaptation framework that replaces dense mask supervision with binary preferences. We observe that different prompt templates produce systematically different segmentations for the same image, a phenomenon we call prompt disagreement, and we repurpose it as a built-in source of preference supervision. Building on this, we mine localized preference queries from regions of high cross-template uncertainty, and adapt the OVSS model with Region-Localized Preference Optimization (RLPO) together with consistency regularization that stabilizes updates outside the queried region. Across extensive experiments on the MESS benchmark, the proposed method achieves consistent gains across diverse OVSS backbones without any pixel-level annotation, and remains effective under noisy preferences. Our code is available at https://github.com/blue-531/pref-ovss.

Mon 28 SeptComputer Vision and Pattern Recognition
The gist
Semantic segmentation assigns labels to every pixel in an image, but models often struggle when applied to specialized areas like medical images or satellite photos. This paper shows how asking simple yes-or-no questions about uncertain parts of an image can help improve these models without needing detailed, hard-to-get labels. The authors use disagreements between different text prompts as clues to figure out where to ask these questions, leading to better segmentation results. Their method works well on various existing models and remains effective even if some answers are noisy.
Open → 2609.34528v1

GeoCR removes clouds from satellite images across sensors and bands

GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations

Abstract: Cloud removal methods are typically specialized to individual datasets and input configurations, limiting reuse across sensors, spectral bands, and observation settings. We introduce GeoCR, a generalist model that unifies RGB-only-based CR and multispectral-based CR from single- or multi-temporal cloudy observations, with optional SAR guidance, within a single network. To accommodate different spectral and sensing domains, compact input and output stems extend a pretrained RGB autoencoder while keeping its encoder and decoder trunks frozen. This shared latent interface enables a single flow transformer to jointly model clean RGB and non-RGB latents, conditioned on separate cloudy-observation streams and optional SAR tokens. Through joint pretraining on the training splits of ten datasets comprising 883,331 cloud-free target images, GeoCR learns a shared cloud removal prior across these heterogeneous configurations. The same pretrained checkpoint supports direct inference without dataset-specific fine-tuning and efficient adaptation through low-rank adaptation (LoRA). We evaluate GeoCR against general image restoration and cloud removal methods on test splits of the contributing datasets under full-band and RGB-only settings. GeoCR achieves the best FID and DISTS on full-band SEN12MS-CR and Sen2_MTC_New and RGB-only CUHK-CR2, outperforming existing models and demonstrating the effectiveness of a reusable generative model across diverse settings.

Sat 26 SeptComputer Vision and Pattern Recognition
The gist
Clouds often block the view in satellite images, making it hard to see the land below. The authors created GeoCR, a single model that can clear clouds from many types of satellite images, including those with different colors and radar data. GeoCR learns from a huge variety of cloud-free images so it can work well on new images without extra training. This means fewer clouded images and clearer pictures for tasks like monitoring the environment or mapping.
Open → 2609.32510v1

Hyperspectral video compression improves quality and tracking accuracy

Implicit Neural Representation for Hyperspectral Video Compression

Abstract: With the advent of snapshot cameras, hyperspectral video is becoming more readily available. In recent years, new applications have emerged which have led to increasingly larger datasets. However, hyperspectral video compression remains in the early stages. In this study, we explore the use of implicit neural representation as a candidate solution. We propose a novel extension of an existing RGB video compression model, achieving Bjøntegaard Delta PSNR gains of +4.99 dB and Bjøntegaard Delta rate of -88.88% compared to traditional hyperspectral image compression methods applied frame-by-frame. In addition to reconstruction quality, the effects on downstream task performance are measured in the form of object tracking success. Compared to video compressed with methods based on principal component analysis and JPEG2000 in low data regimes, our proposed method improves tracking area under the curve by up to 23.42% and distance precision by up to 35.56% on examples from the HOT2026 dataset.

Fri 25 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Hyperspectral videos capture more colors than regular videos but create huge data files that are hard to store and share. The authors improved how these videos are compressed using a special kind of neural network, making the files much smaller while keeping the video quality better than older methods. This also helped computer programs track objects in the videos more accurately. Their method works better, especially when there isn’t much data to work with.
Open → 2609.31435v1

Flow matching improves speed and detail in SAR to optical image conversion

ContraFM-S2O: Flow Matching-Based One-step SAR-to-Optical Image Translation Model with Contrastive Learning

Abstract: In recent years, diffusion models and GAN-based models have become the mainstream approaches for SAR-to-optical image translation, owing to their advantages, such as high-quality generation and stable training. However, they have shortcomings such as high inference latency and the generated optical images suffer from low detail fidelity, often resulting in blurred edges and loss of fine textures. Thus, we propose ContraFM-S2O, which is a flow matching-based model for SAR-to-optical image translation. Unlike conventional diffusion models, ContraFM-S2O learns to predict the velocity field in training and solves ODE instead of SDE during inference to improve the sampling efficiency. In addition, ContraFM-S2O replaces instantaneous velocity with average velocity along the interpolation path to realize one-step SAR-to-optical image translation and uses contrastive learning to improve the quality of the generated optical images. Experiments show our model achieves state-of-the-art on SAR2Opt and QXS datasets, outperforming baselines, and reduces inference latency via one-step generation.

Fri 25 SeptComputer Vision and Pattern Recognition
The gist
Turning radar images (SAR) into regular photos that people can understand is hard because details often get blurry or lost in the process. The authors created a new method called ContraFM-S2O that uses a mathematical technique called flow matching to convert images faster and with clearer details. Instead of taking many slow steps, their approach predicts the full transformation in one go. They also use a learning method called contrastive learning to make the converted images more accurate and sharp. Tests show their method works better and faster than older methods on common datasets.
Open → 2609.31378v1

Selective tool use improves change question answering in satellite images

Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing

Abstract: Change visual question answering (Change VQA) requires understanding semantic changes across bi-temporal remote sensing images. Although vision language models (VLMs) have shown promising performance on this task, they remain unreliable when answering questions that require explicit transition statistics, area measurements, or spatial information. To address this limitation, we propose a selective tool use framework in which a single VLM either answers directly or invokes a deterministic change analysis tool to obtain question specific evidence. Specifically, the selected tool operates on bi-temporal semantic maps and returns a structured observation, which the same VLM uses to generate its final answer. To support this framework, we construct a tool augmented extension of CDVQA covering eight question families and three tools for transition, spatial, and temporal analysis. Tool use supervision and observations are derived automatically from the original semantic annotations, without additional manual labeling. We then adapt Qwen3.5-4B using Low Rank Adaptation (LoRA) to jointly learn direct answering, tool invocation, and evidence conditioned answering. Experiments on 7,164 test questions show that selective tool use with reference semantic maps improves overall accuracy from 73.77% to 88.79% and average family accuracy from 69.11% to 89.65%. When the semantic maps are predicted automatically, the framework achieves 77.47% overall accuracy and 75.06% average family accuracy. These results demonstrate the benefit of question-specific semantic evidence for Change VQA, while highlighting the influence of semantic prediction quality on the resulting performance. Code and tool-augmented annotations will be made publicly available at https://github.com/yakoubbazi/ToolChangeVQA.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Answering questions about how land changes over time using satellite images can be tricky, especially when precise details like area size or location matter. The paper presents a method where an AI first decides if it can answer directly or if it should use special analysis tools that measure changes in the images. These tools provide clear evidence which helps the AI give better answers. This approach significantly boosts accuracy, especially when the analysis maps are precise.
Open → 2609.14523v1