New method reduces unwanted concepts in retrieval-based text generation
C$^2$U in RAG: Compositional Concept Unlearning in Retrieval-Augmented Generation
Computation and Language
Summary
Sometimes, when AI models generate text using retrieved documents, unwanted ideas or topics can show up even if the AI is carefully controlled. This paper studies how to stop certain concepts from appearing by changing only the search query in a very limited way. The authors introduce a technique called Compositional Concept Unlearning (C2U) that edits queries to reduce exposure to specific unwanted content without harming normal queries. Tests on different datasets and encoders show it effectively lowers the chance of seeing targeted concepts while keeping other results stable.
What this means in practice
- •For search engine developers: Improve search query processing to suppress unwanted or sensitive topics in generated content without degrading overall search quality.
- •For chatbot engineers: Control the appearance of undesirable concepts in chatbot responses by subtle adjustments in query representation to enhance moderation.
Authors
Yiyang Duan, Fan Wu, Tiantong Wu, Che Wang, Zhiren Gong, Wei Guo, Yang Cao, Wei Yang Bryan Lim
Abstract
Retrieval-augmented generation can expose unwanted concepts through retrieved evidence even when the generator is moderated. We study query-side concept suppression with a fixed encoder and document index. Compositional Concept Unlearning (C$^2$U) routes a profile-derived direction through an augmented atom bank, adding only a bounded edited-minus-original delta to the raw query. Across five datasets, four encoders, and three seeds, the validation-selected configuration reduces pooled binary target Hit@5 by 4.25 percentage points with non-positive control degradation and target-exposure changes. Under the evaluated query transforms, it suppresses target density without increasing budgeted control-query exposure. Separately, ArXiv four-concept composition improves over an averaged-direction comparator after independent validation gates and first-use test evaluation.