Circe uses model internals to check large language model answers

Circe: Training-Free LLM Self-Evaluation via Component Interaction Consistency

Artificial Intelligence

Summary

Checking if large language models give correct answers is hard when you don't have the right answers to compare against. The authors present Circe, a new way to tell if a model’s answer is likely right by looking inside how the model thinks, without needing extra training or reference answers. Circe examines how different parts of the model work together and how the model’s internal states change, plus how confident the model is in its answer. Tests show Circe is better than existing methods at spotting right and wrong answers in many kinds of tasks and languages.

What this means in practice

  • For llm deployment teams: Automatically estimate answer correctness without reference data to improve model reliability in real-world applications.
  • For multilingual app developers: Assess language model outputs across many languages without extra labeled data, enhancing multilingual product quality.

Authors

Shuyi Miao, Zheng Li, Xu Xie, Linrui Xu, Fei Shen, Xiaoyu Du, Tat-Seng Chua

Abstract

As large language models (LLMs) are increasingly deployed in real-world applications, evaluating the correctness of their responses is crucial for reliable use. However, such evaluation is challenging because reference answers are rarely available in practice. Existing reference-free methods mainly rely on output signals, which may assign high scores to incorrect responses and thus do not necessarily reflect correctness. This motivates exploring the model's internal computation for complementary correctness signals. Recent studies exploit internal states, but they mainly analyze hidden-state trajectories across layers, which record only the combined updates of attention and feed-forward networks (FFNs) and overlook how these components interact. We therefore propose Circe, a training-free self-evaluation method that assesses a response using both internal and external signals, without reference answers or repeated sampling. For internal signals, we first introduce component interaction consistency (CIC), which measures the directional alignment between attention updates in earlier layers and attention-induced FFN output changes in later layers. We further incorporate representation geometry (RG) to characterize normalized displacement and angular changes along layerwise hidden-state trajectories. For the external signal, we convert the mean negative log-likelihood of generated tokens into a bounded likelihood confidence (LC) score. Finally, we fuse CIC, RG, and LC into a unified correctness score. Experiments on five LLMs and six benchmarks across four domains show that our method distinguishes correct from incorrect responses more effectively than existing baselines, and generalizes to multilingual, multimodal, and open-world settings.