Agents check community ratings for trustworthy resources online
Reputation as Community Memory for the Agentic Web
Multiagent SystemsDistributed, Parallel, and Cluster Computing
Summary
When software agents use online resources, they need to know which ones are reliable. The authors propose a community-based reputation system called Cairn, where many agents share their experiences to build trustworthy ratings. This collective memory helps agents decide which data sources or tools to trust by combining many opinions and resisting dishonest reports. Cairn was tested to handle attacks like lying and collusion, demonstrating it can support agents in choosing better resources.
What this means in practice
- •For software developers: Add collective reputation checks to software agents so they select more reliable data sources and tools automatically.
- •For security teams: Use community-backed reputation systems to detect and reduce impact of malicious resources or agents in distributed environments.
Authors
Ryan Chard, Gus Ellerm, Alexander Brace, Alok Kamatar, Suman Raj, Ian Foster, Kyle Chard
Abstract
Agents can now externalize experience into memory, consolidating historical traces into semantic knowledge and procedural shortcuts that persist between sessions. Such memory is typically private to a single agent. We argue that agentic memory benefits from being collective, because trustworthy knowledge of the shared environment---the data sources, services, and tools agents depend on---cannot be established by any single agent, only corroborated across many independent observers. We present Cairn, a community reputation platform that captures collective knowledge, allowing agents to query the community's opinion of a resource before use and to submit evidence-backed ratings afterward. Cairn aggregates observations via a time-decayed Beta model with confidence shrinkage and supports semantic discovery over reviewer rationales. We evaluate Cairn's reputation engine under adversarial simulation (e.g., lying, collusion, camouflage), benchmark its retrieval performance, and report a case study of rating heterogeneous agents in production.