Semantic-Spatial Discriminability Enhancement for Generalized Visual Grounding
2026-08-31 • Computer Vision and Pattern Recognition
Computer Vision and Pattern Recognition
AI summaryⓘ
The authors address a problem where a system needs to find objects in images based on descriptions, even when there are multiple similar objects or no targets at all. They propose a new method called SSDE that improves how the system distinguishes small details and the exact location of each object. Their approach uses two parts: one to better understand the fine details of the description and image together, and another to map where objects are in the image to keep them separate. Experiments show their method works better than previous ones on many tests.
Visual GroundingReferring ExpressionsCross-attentionSemantic DiscriminabilitySpatial LocalizationInstance-level GroundingCenter Density MapMulti-target ScenariosCross-modal UnderstandingAuxiliary Supervision
Authors
Kaiyan Lei, Xu-Yao Zhang
Abstract
Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous methods typically rely on global semantic matching or coarse-grained region interactions for localization, where the discriminative cues are primarily derived from sentence-level semantics or regional context. In complex multi-target scenarios, such approaches tend to confuse visually similar targets, making it difficult to establish stable instance-level decision boundaries. To address these limitations, this paper proposes a novel Semantic-Spatial Discriminability Enhancement (SSDE) framework for generalized visual grounding, which aims to enhance the discriminative ability on fine-grained semantics and spatial localization, improving both cross-modal understanding and instance-level grounding. Specifically, to enhance the semantic discriminability of query representations at the fine-grained level, we propose a Semantic Discriminability Enhancement (SeDE) module, which leverages spatially guided cross-attention to disentangle fine-grained target-relevant visual attributes and integrates them with the textual subject semantics. Furthermore, to strengthen the spatial discriminability of the referred targets, we introduce a Spatial Discriminability Enhancement (SpDE) module, which models an instance center density map to characterize the spatial distribution of targets, and explicitly constructs instance separation structures in the spatial domain by employing them as an auxiliary supervision signal. Extensive experiments show that SSDE achieves superior performance on ten datasets across both classic and generalized visual grounding tasks.