Multi-agent systems are only as safe as their weakest model

Only as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-Agent

Multiagent SystemsArtificial Intelligence

Summary

Many AI systems use multiple models working together, where a strong main model delegates work to smaller, weaker helper models. The authors show that attacks which fail on strong single models can succeed when these models work in teams. Even if the main model is very safe, the system’s safety is limited by the weakest helper model it uses. This means that multi-agent AI can be vulnerable in ways not seen when models work alone.

What this means in practice

  • For ai system developers: Design multi-agent systems with careful assessment of weakest sub-agent vulnerabilities to improve overall system safety.
  • For security teams in ai companies: Monitor and harden multi-agent workflows to prevent attacks that exploit weaker sub-agent models within otherwise strong systems.

Authors

Keegan Wang, Anantika Mannby

Abstract

Major industry multi-agent systems like Codex and Claude Code can be broken by attacks that have long been unsuccessful against modern frontier models. AI Safety as a discipline has largely focused on finding the bounds and vulnerabilities of AI models used in isolation. Yet as humans increasingly deploy these models as agents and multi-agent systems, the same attacks that had been thought to be patched when using a model in isolation can break these same models under specific circumstances. We show that these system breaks are not purely theoretical, but can break Claude Code, Codex, and a reference harness, all unmodified and used with their own sub-agent mechanisms. We show the attack by asking agents to answer questions from a store of files on disk in which we have planted a forged record. Searching the store themselves, the strong model orchestrators commit almost zero harmful revisions in over 1,000 trials. However, if that same orchestrator model delegates to a cheaper sub-agent, which is what these harnesses are built to do, the same models on the same facts fail on 20/180, 44/180, 75/180 and 553/900. Thus, even when the system is driven by a strong model, the system's safety lands near the weak reader's, not the orchestrator's. Simulations over 18 models show the same effect in the delivery channel where five aggregators, who on their own were almost never unsafe, repeat a corrupted sub-agent's error in 751/757 trials. The safety of real-world agentic systems that use strong orchestrator agents and weaker sub-agents, and multi-agent systems in general, is defined not by the safety of the strong agent but by the safety of the weakest agent.