Papers for

data science teams in legal firms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Generative AI and manual review perform similarly for eDiscovery tasks

Comparing GenAI to Machine Learning and Manual Review for eDiscovery

Abstract: Keeling et al. [Keeling2026Generative] report on a case study recently conducted by Redgrave LLP in which they assert that Relativity's Generative AI Review tool (aiR) achieved 88% recall while Relativity Assisted Learning (RAL), its machine-learning tool, achieved 64% recall. These results are not comparable because the methods employed have different objectives, because of inter-assessor disagreement, and because they represent different recall-precision and cost-benefit trade-offs. Our analysis of the Redgrave data indicates that, when these differences are taken into account, aiR and manual review are comparable. Furthermore, established machine-learning models employing Continuous Active Learning (CAL) show state-of-the-art effectiveness, and superior efficiency, when trained only on a sample of 2,000 first-pass-reviewer responsiveness determinations.

Mon 12 OctMachine LearningArtificial IntelligenceInformation Retrieval
The gist
Finding important information in large collections of documents for legal cases is challenging. Keeling et al. compared a generative AI tool with machine learning and manual human review. They found that generative AI and manual review have similar effectiveness when you consider their different goals and trade-offs. Their analysis also shows that advanced machine learning methods can be even more efficient and accurate when given a small set of initial human decisions.
Open → 2610.16925v1