Papers for

medical review teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

ReviewPilot automates paper screening and data extraction in reviews

ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews

Abstract: Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We develop a conversational multi-agent system called ReviewPilot that automates the PRISMA workflow from paper screening to information extraction. Researchers can tailor criteria and schemas through dialogue, and a project memory keeps their configurations and revisions. Each screening decision comes with its reason and each extracted value with its source. On epidemiological expert reviews, ReviewPilot outperforms a single-prompt LLM and AgentSLR across three LLMs, with screening macro F1 up to 0.776 and extraction F1 up to 0.788. Case studies in biomedicine and human-computer interaction show close agreement with human annotators, suggesting that ReviewPilot can transfer beyond epidemiology. Code is available at https://github.com/ZhaoqianXue/ReviewPilot.

Thu 15 OctComputation and LanguageArtificial IntelligenceInformation Retrieval
The gist
Systematic reviews check many scientific papers to decide which to include and to gather important data. The authors created ReviewPilot, which uses multiple AI agents to help researchers quickly screen papers and extract information with clear reasons and sources. Unlike simpler tools, ReviewPilot remembers user settings and explains its decisions. Tests showed it works better than some existing AI methods, especially for health studies, and works well in other fields too. The tool and its code are available for anyone to use.
Open → 2610.21042v1

EviStreams lets medical teams control AI data extraction for reviews

EviStreams: Human-in-the-Loop AI Data Extraction for Systematic Reviews in Medicine

Abstract: Systematic reviews underpin clinical guidelines, yet their data-extraction step is a major expert-labor bottleneck bound by a protocolized workflow: two reviewers extract each study independently, an adjudicator resolves disagreements, and the team keeps an auditable record of how every value was produced. Large language models can assist with extraction, but that assistance must fit established review protocols and preserve reproducibility. We present EviStreams, a live, open-source, no-code web platform that puts review teams in control of AI-assisted extraction at three key stages: program design (a structured decomposition approved before any code runs), field specification (typed field definitions calibrated from a pilot), and extracted predictions (reviewer-blinded dual review with adjudication). Working through a form builder, a domain expert defines typed fields rather than prompts, runs extraction over uploaded PDFs, inspects every value alongside the supporting passage it came from, and resolves a reviewer-blinded dual review into an auditable consensus export. An evaluation across four clinical corpora and three frontier model families, released with the system, shows that extraction quality is shaped far more by the field specification than by the choice of model. EviStreams is live at https://evistreams.com/demo and released under Apache-2.0.

Wed 23 SeptComputation and Language
The gist
Systematic reviews in medicine require experts to carefully pull data from many studies, which is time-consuming and must follow strict rules. The authors present EviStreams, a web platform that helps review teams guide AI in extracting data while keeping human oversight and follow protocols to ensure accuracy. Experts use a form builder to define data fields, review AI-suggested values alongside evidence, and resolve any disagreements anonymously for a reliable final dataset. They found that how fields are defined impacts extraction quality more than which AI model is used.
Open → 2609.27418v1