Gated memory improves fact storage quality in conversational AI systems
Gated Memory: Admission-Controlled Memory Formation for Conversational AI
Computation and LanguageArtificial IntelligenceInformation RetrievalMachine Learning
Summary
Conversational AI systems need to remember important facts about a user over time, but deciding which facts to save can be tricky. The authors found that current methods lose important context from the original conversation when storing facts. They propose a new system called Gated Memory that carefully decides which facts to keep and adds extra information like when and where the fact applies. This method improved memory accuracy in tests with emotionally rich conversations.
What this means in practice
- •For conversational ai engineers: Build AI systems that store user facts more accurately by filtering and enriching information before memory formation.
- •For customer service platform developers: Enhance chatbots with gated memory to better recall user preferences and context in ongoing interactions.$Commercial implications: Enables creation of personalized AI assistants that improve customer engagement through higher-quality memory handling.
Authors
Preeti Saraswat, Divya Neelagiri, Ajay Manoj
Abstract
Personalized conversational AI relies on long-term memory systems that extract facts from user utterances and store them in persistent vector stores. Despite progress in retrieval, deduplication, and lifecycle management, the formation stage, the moment a fact is first written to storage has received almost no principled attention. We identify this as the binding constraint on memory quality in production systems. Critical contextual signals, such as the distinction between a permanent user attribute and a transient situation, exist only in the original utterance and are irreversibly lost the moment extraction produces a subject-relation-object triple. No downstream process can recover them. We propose Gated Memory, a lightweight, modular formation framework that interposes two decision checkpoints between conversation and storage: an admission gate that evaluates every candidate fact against the full utterance context before extraction runs, and a conditional enrichment stage that grounds admitted facts through an entity scope taxonomy with privacy constraints. The gate evaluates only the current exchange while using prior turns as read-only reference context, and produces a structured formation record. Admitted content is decomposed into atomic facts, each categorized, tagged with provenance (directly stated versus inferred), scoped to its condition of applicability, and grounded in resolved time and place, subject to a constraint that no entity absent from the context may be asserted. On the LoCoMo-10 benchmark with atypical emotional density in utterance data, Gated Memory achieves an overall +2.6% relative improvement in LLM-judge accuracy over a strong baseline with identical retrieval and generation, establishing formation quality as a measurable constraint on memory performance.