Dependency-Guided Code Generation: Structured Matrix Decomposition and Consistency-Guided Refinement

Software EngineeringComputation and Language

Summary

The authors address the problem of generating software code automatically by focusing on how different parts of the code depend on each other. They created a framework that represents these dependencies using graphs and breaks them down into strong, clear relationships and weaker, hidden ones. By learning this structure, their method helps produce code that makes more sense and fits better in actual software projects. They also improve efficiency using a special way to store strong dependencies. Their experiments show better results than previous methods.

Authors

Mingqiao Mo, Yangchen Zeng, Zikai Xiao, Xin Xiao, Wenhua Nie, Zhaolu Kang, Guangyuan Dong, Kai Shu, Hao Zhang, Xiaodong Fan

Abstract

The increasing complexity of modern software systems has made automated code generation a fundamental task in software engineering. However, existing approaches often fail to adequately capture the intricate, multi-level dependencies among code entities, leading to generated code that is logically incomplete or difficult to integrate into real-world systems. To address this limitation, we propose a dependency-aware code generation framework that explicitly models interactions among code entities through a graph-based representation. We decompose dependencies into two complementary components: a quantized matrix that captures strong, explicit relations, and a sparse low-rank factorization that models weaker, implicit interactions. The decomposition is efficiently learned via an alternating optimization procedure. During code generation, the learned dependency structure is incorporated as a constraint, ensuring both semantic coherence and structural consistency of the generated code. Furthermore, we introduce a sparse triplet representation for strong dependencies, significantly improving storage efficiency and computational scalability. Extensive experiments demonstrate that our approach consistently produces code with superior semantic alignment and structural fidelity compared to existing methods.