Securing Agentic AI: From Per-Action Checks to Trajectory Assurance

2026-08-03Artificial Intelligence

Artificial IntelligenceCryptography and SecurityMultiagent Systems
AI summary

The authors explain that autonomous agents, especially those using large language models, need to follow complex rules and work safely within different systems. Instead of just checking if each action is correct, the overall behavior must obey important constraints. They point out risks from bad inputs, problems when agents communicate or share tasks, and bigger issues like tracking where software comes from and making sure everything is trustworthy. The authors suggest security should be built into the whole system, not just added later, to help make autonomous agents safer and more reliable.

autonomous agentslarge language modelsoperational constraintsbehavioral containmentmulti-agent systemsattack surfaceprovenancesecurity architecturedelegationtrustworthiness
Authors
Alireza Lotfi, Subangkar Karmaker Shanto, Imtiaz Karim, Elisa Bertino
Abstract
Autonomous agents are increasingly used to execute consequential tasks in environments governed by operational constraints, organizational policies, regulatory requirements, and technical standards. Their safety is therefore determined not by the correctness of individual actions, but by whether their overall behavior remains consistent with the rules and invariants of the systems in which they operate. As large language model (LLM)-based agents become more autonomous and increasingly delegate tasks across organizational boundaries, securing them evolves from a single challenge into a broad and interconnected landscape spanning the entire agentic stack. At the single-agent level, untrusted inputs through prompts, memory, retrieved knowledge, and tool interfaces create attack surfaces. In multi-agent settings, delegation and communication introduce challenges related to identity, trust, capability control, and decision transparency, while the underlying model routing and execution control plane remains vulnerable to manipulation and to unverified model provenance. Perhaps the most fundamental challenge is behavioral containment: sequences of individually permissible actions may collectively violate system-level constraints and safety invariants. At the broader level, supply-chain integrity, provenance, accountability, and end-to-end observability remain largely open problems. A common principle unifies these directions: security must become a verifiable property of the architectures, protocols, and runtimes that govern agent behavior, rather than an optional layer of guidance. Charting these challenges provides a roadmap toward trustworthy autonomous agent deployment.