Understanding Stage-Wise Utility-Risk Trade-offs in LLM Agent Memory

2026-08-31Cryptography and Security

Cryptography and Security
AI summary

The authors study how long-term memory in large language models (LLMs) affects both their usefulness and vulnerability to harmful attacks called memory poisoning. They create a tool named MemGauge that separately tests how information is written, managed, and retrieved in memory, comparing clean and attacked conditions. Their tests on many models show that risk and utility change differently at each stage of memory operations. They suggest that understanding these stage-specific effects is important for making safer and more effective LLM memory systems.

long-term memorylarge language modelsmemory poisoningwriting admissionmanagement policyretrieval exposurememory benchmarksattack riskmemory utility
Authors
Chuanchao Zang, Zijian Cao, Xiangtao Meng, Jianing Wang, Wenyu Chen, Xinyu Gao, Li Wang, Zheng Li, Shanqing Guo
Abstract
Long-term memory is becoming a core capability of LLM agents, enabling personalization and long-horizon interaction. However, memory mechanisms that retain, transform, or expose more information can affect both benign utility and susceptibility to memory poisoning. Existing evaluations typically measure memory utility or attack risk in isolation under fixed configurations, providing limited insight into how stage-specific design choices reshape their trade-off. We present \textsc{MemGauge}, a controllable framework that separately varies writing admission, management policy, and retrieval exposure under matched clean and poisoned conditions. Across 11 LLMs and two long-term memory benchmarks, controlled evaluations reveal three distinct profiles: a threshold-like risk transition during writing, policy-dependent local decoupling during management, and coupled growth of utility and risk during retrieval. We further apply analogous stage-level measurements to four existing memory systems and observe diagnostic associations qualitatively consistent with these profiles. These results show that targeted poisoning risk varies across memory operations and motivate stage-aware evaluation and control of LLM-agent memory.