Probeid verifies large language model tools despite changing responses

ProbeID: Verifying MCP Tool Identity for LLM Agents under Registry Drift

Cryptography and SecurityArtificial Intelligence

Summary

Large language model (LLM) agents often pick tools to use based on descriptions that anyone can copy, making it hard to know which tool is really running. The authors propose ProbeID, a method that sends specific test questions called probes to tools and checks their responses against a trusted reference to confirm the tool's true identity. If the answers are ambiguous, ProbeID rejects the tool, so impostors must mimic observable behaviors exactly to pass. Tests show ProbeID can detect changes in tool behavior over time, improving task reliability by filtering out altered tools without hurting performance. The method depends on good reference data and coverage of probe questions.

What this means in practice

  • For llm platform engineers: Confirm the true versions of tools integrated with agents by behavioral probes to avoid executing altered or malicious tool implementations.
  • For api security teams: Use ProbeID to detect and reject unauthorized or drifted tool clones replacing expected APIs in agent ecosystems.

Authors

Guanxing Chen, Sining Zhang, Haohuai He, Qiujie Lv, Yu-An Huang, Zhi-An Huang

Abstract

Agents select tools by copyable descriptions, which cannot establish which implementation runs. ProbeID compares canonicalized responses to schema-valid probes with a trusted admission reference and abstains on ambiguity, so a squatter must copy probe-observable behavior. With the gold present, independent probes and a fixed margin, standard concentration arguments give a shared probe budget logarithmic in the candidate count and bound the joint probability of a wrong decision. On cached MCP-IdentityDrift cases, strict choice reaches \(0.956\) hit@1 while description routers fall near chance, but simpler exact comparisons tie it, MMD better tolerates heavy value noise, and a 32B behavioral judge is similarly accurate at higher cost. Random probes from agent banks and a prospective held-out study of 38 tools test theory-set thresholds. On the agent banks, equality refuses every reachable replacement from 64 probes and the bounded distance from 512, and sharper post hoc gates halve both. Two tools whose drift no bank probe reaches always pass. In an MCP-Bench agent, verification cuts tainted tasks from 15 to 9 of 16 at unchanged task success. Over eleven weeks, 7 of 59 real tools changed responses despite version pins. Verification depends on reference integrity, probe coverage, and response noise.