Papers for

intelligence analysts

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Framework explains how to find truth in biased stories and arguments

The Tiglath Pileser principle and models of persuasion

Abstract: This paper develops a formal framework for analysing how agents extract reliable information from narratives and communicative interactions involving strategic deception. Building on Rubinstein and Glazer's models of persuasion, we introduce Tiglath-Pileser relations, a generalization of codex-based guidance relations, to formalize Baruch Halpern's Tiglath-Pileser principle: despite systematic bias, reported claims must retain a connection to the truth. We analyse these relations set-theoretically and axiomatically, identifying conditions for their successful application in persuasion. Our dynamic approach examines how such relations are formed, revised, and strategically manipulated, extending existing models beyond one-shot interactions. Two case studies, including a formal reconstruction of Halpern's interpretation of the biblical account of King David, illustrate the framework's application to historiographical reasoning. Combining logic, epistemic reasoning, and game theory, the paper provides an account of belief formation and truth approximation under partial information and strategic manipulation.

Thu 12 NovLogic in Computer Science
The gist
People often hear stories or claims that might be biased or even intentionally misleading. This paper introduces a way to think about how listeners can still find reliable information within those stories by tracking connections to the truth. The authors build a mathematical framework that describes how information changes when people share it strategically, even over time. They show how this approach can be used to understand real historical stories and how beliefs form when you only have partial or twisted information.
Open → 2611.16459v1

TimelineAgent builds event timelines from many documents by query

TimelineAgent: An LLM-based Framework for Query-Centric Event Timeline Extraction Across Multiple Documents

Abstract: Query-centric cross-document event timeline extraction aims to construct event timelines from multiple documents under diverse query focuses. The task is very challenging due to the heterogeneous event modeling and reasoning requirements arising from both the intrinsic complexity of cross-document timeline construction and the diversity of query focuses. In this paper, we propose TimelineAgent, an LLM-based multi-agent framework featuring a multi-stage reasoning workflow, where heterogeneous event features are organized into reusable skills and orchestrated through a goal-oriented protocol. To facilitate evaluation, we construct a benchmark covering diverse query focuses. Experimental results show that TimelineAgent consistently outperforms existing methods, offering a practical framework for complex real-world timeline construction.

Mon 19 OctArtificial Intelligence
The gist
Understanding how events unfold over time from many documents is hard, especially when questions vary. The authors present TimelineAgent, which uses a large language model with multiple agents working in steps to gather and organize event details. They also created a special test set to measure how well different methods work on this kind of timeline task. TimelineAgent did better than previous approaches, showing promise for real-world uses where you want to track event sequences based on different queries.
Open → 2610.25733v1

Benchmark tests ai on geopolitical report question answering

GeopoliticalQA: Benchmarking Retrieval and Generation over Intelligence Reports

Abstract: Geopolitical and strategic intelligence reports constitute a rich source of expert knowledge and have increasing value in the current political climate, but their heterogeneity and analytical complexity pose challenges for retrieval-augmented question answering. We introduce a benchmark for grounded question answering over 415 open-source geopolitical and strategic intelligence reports, comprising 5,525 document-grounded question-answer pairs spanning factual, inferential, comparative, and risk-oriented questions. We propose a document-aware generation pipeline that profiles reports before generating questions and validate dataset quality through expert annotation and an LLM-as-judge protocol. Using the benchmark, we evaluate 15 retrieval systems and six open-weight LLMs for RAG. We find that models perform similarly on document-level retrieval, while at the harder chunk level retrieval quality is not driven by embedding-model scale: bge-m3, a mid-size open encoder matches an order of magnitude larger ones and outperforms commercial embedding APIs. In contrast, answer generation remains challenging even given the gold evidence, particularly for inferential and risk-oriented questions.

Thu 8 OctComputation and LanguageInformation Retrieval
The gist
Understanding complex intelligence reports is tough because they are very detailed and cover many topics. The authors created a special set of questions and answers based on these reports to test how well AI systems can find information and give answers. They checked many different AI systems and found that while some can retrieve documents well, actually answering tricky questions is still hard. Their work helps show which parts of AI need improvement to better handle these important reports.
Open → 2610.12617v1

Web tool uses argument schemes and ai to analyse deception in texts

DeceptionAnalyser: A Web-Based AI Tool for Performing Structured Deception Analysis with Argumentation Schemes and LLMs

Abstract: Deception plays a central role in Intelligence operations, yet it remains difficult to analyse systematically without expert knowledge of reasoning patterns and cognitive manipulation. In computational argumentation, for instance, no scheme-level ground-truth corpora currently exist to support statistical validation. In this paper, we address this by introducing a set of ten argument schemes designed to model distinct forms of deception, each accompanied by structured premises and critical questions. In doing so, we introduce the first dedicated library of argumentation schemes specifically designed for deception analysis, providing a structured foundation for systematically modelling and analysing deception in narrative text. We then present \textit{DeceptionAnalyser}, a browser-based tool that implements these schemes through a two-stage methodology combining LLM-based premise extraction with critical-question-driven evaluation. Our aim is to provide a conceptual and methodological foundation for analysing deceptive reasoning in narrative text. This is precisely what we address in this paper by demonstrating how structured argumentation theory and AI-assisted analysis can support transparent, explainable assessments of potential deception. Because the schemes are designed to flag claims for scrutiny rather than to output a deception verdict, we do not benchmark classification accuracy; instead, we assess the \emph{reliability} of the methodology by measuring the consistency of the tool's premise and conclusion assessments across ten contemporary large language models and repeated runs. We find that scheme detection is highly stable for clear-cut deception and degrades gracefully, in interpretable ways, on more ambiguous intelligence-style narratives.

Mon 21 SeptHuman-Computer InteractionArtificial Intelligence
The gist
Detecting lies and trickery in stories or statements is very hard, especially without experts who know how deception works. The authors created ten patterns that model different kinds of deception, making it easier to spot when claims need closer checking. They built a web tool called DeceptionAnalyser that uses artificial intelligence to find important parts of a statement and then asks smart, critical questions based on those patterns to evaluate if something seems suspicious. Instead of saying outright if something is a lie, the tool highlights what needs more attention, helping people understand why a claim might be deceptive. They tested this method across many AI models and found it works well for clear cases and degrades gracefully when things are less obvious.
Open → 2609.24369v1

Chinese military news benchmark helps improve event and entity extraction

CMNIE: An Information Extraction Benchmark for Chinese Military News

Abstract: Structured extraction from Chinese military news supports intelligence analysis, decision-making, and knowledge base construction. However, existing resources provide limited support for joint informa?tion extraction in this domain, especially when events, event arguments, entities, and relations must be modeled together. We present CMNIE, an information extraction benchmark for Chinese military news. Extend?ing military-domain resources beyond document-level event annotations, CMNIE jointly annotates event triggers, event arguments, named enti?ties, and entity relations under a unified domain schema. The dataset contains 13,000 instances collected from public Chinese military news, with manual annotations for 7 event types, 10 argument roles, 7 entity types, and 8 relation types. We evaluate supervised IE models, zero-shot large language models, and fine-tuned LLM-based extraction methods on a shared test set. Experimental results show that CMNIE remains chal?lenging, especially for relation extraction and exact matching of event?argument spans; zero-shot LLMs often identify relevant semantic units but fail to match gold span boundaries exactly. CMNIE provides a stan?dardized benchmark for studying schema adherence, exact span match?ing, and joint structured extraction in specialized Chinese news.

Wed 9 SeptComputation and Language
The gist
Extracting detailed, structured information from Chinese military news articles is hard because events, people, places, and their connections all need to be understood at once. The authors created a new dataset called CMNIE with 13,000 carefully labeled news instances that identify different event types, important roles in those events, named entities, and relations between them. They tested current AI models and found the task remains difficult, especially for exact matches of event details and relationships. This dataset creates a shared challenge to help improve how machines understand complex military news in Chinese.
Open → 2609.10722v1