Papers for

legal discovery teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Embedding searches find more trial evidence than label searches

Nothing Left Behind: Finding Evidence from a Large Randomized Evaluation Corpus

Abstract: Many AI systems need to find every relevant items in a large collection and then organize what they found. The standard way to do this is to tag each item with labels from a curated vocabulary and search on those labels. Those labels are useful for organizing results, but searching on them misses items that do not fit a label and returns too much when labels are broad. We compare this approach with an embedding-based approach: find candidates by meaning using text embeddings, then have a language model keep only the relevant ones. In a corpus of 7,354 randomized trials, label search found 45% of the evidence a systematic review would include, while the new approach found 92%, at a cost per query that rises with search depth. These results support a two-stage architecture that combines broad candidate retrieval with query-specific evidence filtering.

Tue 27 OctComputation and Language
The gist
Finding every relevant piece of information in large collections is hard because traditional label-based searches miss many important items and catch too many unrelated ones. The authors compared this old way with a newer method that first finds candidates based on meaning using text embeddings, then uses a language model to keep only what matters. Tested on a large set of randomized trials, the new method found much more relevant evidence than label searches, nearly doubling the recall. They suggest using a two-step approach: gather lots of possible results broadly, then carefully filter them by relevance.
Open → 2610.36910v1

JevGPT improves autonomous research with fast and slow thinking

JevGPT: Thinking Fast and Slow in Autonomous Research

Abstract: Autonomous research agents must acquire and reason over evidence within a limited budget. Yet relevant sources can remain uninspected or unused, leaving a gap between retrieval coverage and the evidence that informs research. The challenge is to align fast local judgments with changing evidence needs and feed their findings back into research decisions. We introduce JevGPT, a dual-system architecture for autonomous research that couples fast evidence processing with deliberative research planning. System Two sets evidence objectives and integrates findings, while System One locates support, assesses relevance, and guides further inspection. Independent source judgments run in parallel; selected original passages inform the next research step. Experiments on fixed-corpus question answering and document ranking show that JevGPT achieves leading task performance, with faster completion and lower cost than comparably effective research agents. Evidence analysis shows broader source inspection and greater coverage of supporting documents in the research loop, highlighting efficient evidence processing as a route to more capable autonomous research.

Tue 13 OctComputation and LanguageArtificial IntelligenceInformation Retrieval
The gist
Autonomous research agents often have limited time and resources to gather and understand information, which means they might miss important evidence. The researchers developed JevGPT, a system that combines quick judgments with careful planning to better find and use information. This approach helps the system cover more sources and make better decisions about what to investigate next. Experiments show JevGPT works faster and cheaper while achieving strong performance on research tasks.
Open → 2610.18272v1

Agentic retrieval improves complex search but needs more time

Beyond Semantic Similarity: Performance and Costs of Agentic Retrieval for Complex Tasks

Abstract: Modern information systems, including many agentic workflows, use dense retrieval to explore large amounts of unstructured data. However, dense retrieval relies on surface-level semantic similarity, which is insufficient for increasingly complex search applications. Here, we investigate agentic retrieval that combines the reasoning capabilities of Large Language Models (LLMs) with the efficient corpus exploration of retrievers in a ReAct agentic loop to solve complex retrieval tasks. In our experiments, we show that agentic retrieval is more effective than standard retrieval, improving nDCG@10 by 8.7 points using the same embedding model. Moreover, while specialized retrieval methods struggle on out-of-domain tasks, agentic retrieval is highly generalizable: the same pipeline achieves competitive results on both the ViDoRe v3 and BRIGHT leaderboards. However, this improvement comes at a cost. On average, agentic retrieval takes 107.4 seconds, compared to 0.67 seconds for standard retrieval, and consumes 764.1K input and 5.8K output tokens per query. In short, our study demonstrates the effectiveness of agentic retrieval in modern data systems and motivates future work on more cost-efficient retrieval agents for large-scale deployment.

Mon 5 OctInformation RetrievalArtificial Intelligence
The gist
Traditional search tools find information by matching words that sound similar, but this does not work well for complicated questions. The authors studied a new approach called agentic retrieval, which uses smart language AI combined with normal search tools to think through complex questions better. This method finds more useful information but takes much longer and uses more computing power. It works well across different kinds of challenging search tasks, showing it is a flexible way to get information.
Open → 2610.05750v1

Corpus map improves search by linking related entities across documents

Follow the Entities: A Corpus Map for Agentic Search

Abstract: Answering questions and completing tasks over large document collections often requires connecting evidence spread across multiple documents, such as a project's approval recorded in one, its requirements in another, and its latest status in a third. Recent LLM agents approach this by iteratively searching the full corpus rather than reading only a fixed set of top-ranked documents. However, when the corpus is exposed only as a flat collection of files, a relevant document gives no indication of how it relates to others, so the agent must rediscover these relationships for every query, often missing complementary evidence while simultaneously consuming substantial additional tokens. To address this, we introduce CorpusMap, a navigation layer that organizes the corpus around its recurring entities, which are identifiable from the documents themselves and can link a single document to many others across sources. Specifically, CorpusMap represents each recurring entity as an Entity Page that aggregates information about it and links to every document that refers to it, forming a graph between entities and documents that the agent can traverse to gather otherwise disconnected evidence. Moreover, since CorpusMap is constructed offline by resolving mentions of the same entity across documents, its links are shared across queries rather than rediscovered repeatedly at inference time. Using 7 different models with 3 benchmark datasets, we show that CorpusMap improves both evidence discovery and answer quality over raw-corpus agentic search while using fewer tokens on average, and further outperforms 4 alternative navigation layers, suggesting that entities serve as effective anchors for navigating large document collections.

Tue 29 SeptComputation and LanguageArtificial IntelligenceInformation Retrieval
The gist
Sometimes when you look for answers in many documents, important clues are scattered in different places. The authors created a system called CorpusMap that organizes these documents by the people, places, or things they mention. This makes it easier for a computer to jump between related documents and find all the clues at once, instead of searching blindly. CorpusMap helps get better answers faster and uses fewer resources by remembering these links ahead of time.
Open → 2609.37226v1