ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning

2026-08-24Machine Learning

Machine Learning
AI summary

The authors explain that current methods for learning on multimodal graphs usually handle graph structure and node features separately, which limits understanding. They introduce ReCoG, a new approach that learns graph connections and node information together by letting them influence each other during training. ReCoG uses a special system to fix and improve graph edges based on multiple types of data and shares information across different data types effectively. Testing shows ReCoG works better than previous methods for tasks like classifying nodes and predicting links. This suggests combining graph structure and features tightly is important for multimodal graph learning.

multimodal graph learninggraph neural networks (GNNs)graph structure learningnode attributescross-modal interactionmessage passingnode classificationlink predictionembedding spacetopology
Authors
Rui Xue, Tianfu Wu
Abstract
Multimodal graph learning requires jointly training over graph structure and heterogeneous node attributes, yet existing methods largely decouple these processes: prior multimodal graph neural networks (GNNs) focus on aligning modalities in a shared embedding space while operating on fixed or weakly adapted graph structures, and graph structure learning approaches infer topology from unimodal node representations without accounting for multimodal interactions. This separation fundamentally limits the ability of GNNs to capture semantically meaningful relationships in multimodal settings, where observed edges are often noisy, incomplete, or misaligned with underlying semantics. We propose ReCoG (Reciprocal Co-Evolution for Multimodal Graph Learning), a new learning paradigm that tightly couples graph structure learning and multimodal representation learning through end-to-end reciprocal interaction. Concretely, ReCoG integrates (i) a multimodal graph refiner that infers and corrects edges using cross-modal semantic evidence, and (ii) a coupled cross-modal message passing mechanism that performs joint intra- and inter-modality propagation over the refined graph. This unified design yields greater expressiveness than decoupled or two-stage formulations and allows dynamic interaction between topology and representation learning. Across diverse benchmarks for node classification and link prediction, ReCoG consistently outperforms strong multimodal graph structure learning baselines, including graph foundation models. Our results demonstrate that reciprocal co-evolution of structure and semantics is important for effective multimodal graph learning, challenging the prevailing separation between topology and representation learning.