Papers for

ai systems developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Persistent memory attacks threaten AI agent security across sessions

When Malicious Instructions Persist: Persistent Memory Poisoning Attack on Harness-Based Agents

Abstract: Harness design has transformed the development of LLM-based agents by integrating memory, tool use, and runtime control. However, this design also introduces security and privacy risks because malicious instructions from external sources may be written into persistent memory and persist across sessions. To study this risk, we propose PMPA, a Persistent Memory Poisoning Attack against harness-based agents. PMPA embeds malicious instructions into benign external sources and induces the victim agent to write them into persistent memory without directly accessing to the agent framework. Once stored, the poisoned memory can be retrieved in later sessions, triggering additional malicious actions and causing privacy leakage. We evaluate PMPA on OpenClaw and Claude Code across different backbone LLMs, input modalities, and trigger scenarios. Across all settings, PMPA achieves average Injection Success Rate (ISR) and Cross-session Attack Success Rate (C-ASR) of 73.7%/ 55.5% on OpenClaw and 66.9%/ 81.7% on Claude Code, while preserving benign task performance on both systems. We further evaluate a targeted prompt-level defense and find that it can reduce memory injection in many settings, but provides limited protection once the persistent memory has been poisoned.

Sat 12 SeptCryptography and SecurityArtificial Intelligence
The gist
Some AI agents use memory to remember information across different times they are used. The authors show how harmful instructions can sneak into this memory without anyone noticing and then cause trouble later on. These attacks can leak private information or make the AI do bad things repeatedly over time. The researchers tested their attack on two popular AI agent systems and found it works in many situations. They also tried some defenses that help, but these defenses are not always enough once the bad memory is stored.
Open → 2609.13889v1