Agents often harmed before reading inputs pose new security risk
Step-Zero Attack: Agent Safety Before Observability
Cryptography and SecurityArtificial IntelligenceSoftware Engineering
Summary
Many AI coding agents can get tricked or damaged not by what they read, but by how they first process files or data before analyzing them. The authors call this early risk "Step Zero," which happens before the AI even looks at the actual content. Their tests showed that agents often overused storage or wrote unwanted files just from this initial step, without any bad content reaching the AI itself. They suggest adding controls that limit how much data these early steps can produce and training agents to check safety before processing anything.
What this means in practice
- •For ai platform developers: Add byte-limiting gates to early input processors to prevent resource misuse before AI content inspection can occur.
- •For software security teams: Deploy layered safety checks that include input inspection and resource budgeting to stop harmful effects caused by initial input handling.
Authors
Tian Qin, Yuhang Jiang, Junzhe Chen, Lit Sin Tan, Lijie Wen
Abstract
Existing attacks and defenses for coding agents act once content enters the model context: injected text persuades the model, and guards inspect what the model reads. Yet to judge whether processing an unknown archive, network response, or image is safe, an agent often must process it first, and that step can do harm before any content reaches the model. We call this first processing Step Zero, and harm done by it a Step-Zero attack. Across seven harnesses and six models, each agent received only a path or URL to a crafted input, paired with a benign twin showing the same visible fields. Step Zero is where most agents are already unsafe: 32/42 harness-model pairs overran a 4 MiB disk budget, 26/42 before the model saw any member, and four of the six models did so in every round (84/84), so the damage precedes any model-side defense. Every twin stayed within budget, so the attacker's bytes alone cause the harm. On network and image inputs the risk moves to what the agent writes: agents stored the body under the name the input declared, letting the input decide what is written, and their checks faded once cues were removed. Model-free tests trace the harm to the processing primitive, so we defend it there: a gate that counts the bytes each call produces held every routed extraction within budget while agents completed 25/28 tasks. Vendors should pair such gates with safety-alignment training that teaches agents to inspect an input before processing it.