AI agent teams achieve faster global problem solving with verified collaboration

Local Work, Global Progress: A Convergence Theory of AI Agent Collaboration

Multiagent SystemsArtificial IntelligenceMachine Learning

Summary

When multiple AI agents work together on a problem, it can be tricky to make sure their teamwork actually improves the overall solution. This paper shows a way to organize their collaboration so that each agent improves only part of the solution without messing up the others. They prove mathematically that this approach reliably leads to better results quickly. The authors also test their method on tasks like robot routing and database query planning, where teams of AI agents solve problems faster than single agents working alone.

What this means in practice

  • For robotics engineers: Improve multi-robot pathfinding by reliably merging partial plans from different AI agents to find collision-free routes faster.
  • For database developers: Accelerate SQL query planning by coordinating AI agents that optimize different parts of the query workload simultaneously.

Authors

Ivan Ilin, Peter Richtárik

Abstract

Teams of large language model (LLM) agents are increasingly applied to complex tasks, but their collaboration protocols are mostly designed empirically, without convergence guarantees. We formalize collaborative problem solving as block optimization: each agent improves one part of a shared solution, guided by its local objective plus a correction for how its changes affect the other parts. A coordinator checks every proposal against the global objective and merges proposals that do not interfere with each other. We prove linear convergence up to an error floor that vanishes when the corrections are exact. Interfering proposals can also be merged once their combination has been checked; the rate then depends on how well the proposals actually combine, not on worst-case interactions. With GPT-OSS-120B agents on robot routing, a three-agent team finds collision-free plans in every run, better than those of a single agent that controls all robots. On a larger routing task, a six-agent team completes its search about twice as fast as the single agent (in median). Merging the best checked combination of proposals, rather than only proposals that do not interfere, cuts the team's search time by about 30%. With constants measured on the runs, our convergence bound holds in every round and follows the observed progress. We also test the theory on query planning in SQLite and on a synthetic task.