Papers for

clinical decision teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Human AI working better without ground truth labels

Complementarity without ground truth?

Abstract: Human-AI complementarity captures the idea that a human assisted by an AI system can outperform both the human and the AI acting alone. In prediction tasks, this improvement is assessed against ground truth labels produced through a reference construction procedure and intended to represent the state of affairs to be predicted. Many human-AI interactions, including those where medical AI provides treatment recommendations, however, concern tasks other than predicting what obtains. Their relevant output concerns adequacy relative to a practical goal and depends on several evaluative dimensions. In this work, we examine the ground truth dependence of complementarity and extend it to human-AI interactions where ground truth is not the appropriate reference. We show that tasks beyond prediction can still admit a reference construction procedure that generates adequacy labels. We develop a route for extending complementarity to such settings. It replaces ground truth labels with context-dependent adequacy labels generated through a two-step scoring methodology inspired by multi-criteria decision analysis frameworks in healthcare and it makes the normative choices underlying reference construction explicit. Because the construction of adequacy labels embeds evaluative choices, we draw methodological inspiration from computational reliabilism to identify technical, scientific, and social factors relevant to supporting their construction. Our approach expands the empirical study of human-AI complementarity beyond prediction tasks, enabling its quantitative evaluation in decision-support settings where ground truth is not the appropriate evaluative reference.

Sat 7 NovArtificial IntelligenceHuman-Computer Interaction
The gist
Usually, when humans and AI work together, we measure how well they do by checking their answers against a known correct answer called ground truth. But sometimes, especially in fields like medicine, there isn’t a clear right answer to check. The authors explore how to measure human-AI teamwork in these situations by creating new ways to judge how good their decisions are based on the specific goals and context. They develop a method that scores decisions using multiple criteria, making the evaluation clearer and more suited to real-world uses where outcomes are complex.
Open → 2611.10893v1

Pairwise neural networks predict brain traits from limited MRI data

Inferring continuous cognitive traits from limited neuroimaging data using pairwise convolutional neural networks

Abstract: Individual differences in cognitive abilities vary widely, yet the structural brain features supporting these differences remain poorly understood. Traditional brain-behavior analyses rely on predefined metrics such as volume or cortical thickness and typically assume linear relationships with behavior, limiting sensitivity in small datasets. Here, we introduce a pairwise convolutional ranking framework that learns directly from whole-brain T1-weighted MRI by making comparative rather than absolute predictions, which performs well even with small samples (N=108). We tested this method with four small-scale spatial abilities tasks. Regression analysis predicted performance with high accuracy across all tasks, achieving greater predictive power over standard regression and pointwise deep learning baselines. Iterative cortical-region removal (backward elimination) revealed brain regions supporting individual performance common to all four tasks, as well as task-specific regions. These results demonstrate that pairwise learning extracts meaningful behavioral information from structural MRI, providing prediction and interpretable insight into the neuroanatomy of individual differences.

Tue 20 OctArtificial IntelligenceComputer Vision and Pattern RecognitionMachine Learning
The gist
People's cognitive skills differ a lot, but it's hard to connect these differences to brain pictures using traditional methods, especially when you don't have many brain scans. The authors developed a new computer method that looks at pairs of brain images and compares them, instead of just looking at one at a time. This approach works well even with a small number of MRI brain scans and can predict how well someone performs on certain thinking tasks. It also helps identify which brain areas are important for those tasks.
Open → 2610.27668v1

Output discipline improves auditable hypothesis decision making accuracy

Output Discipline Sets the Floor: A Falsification-Guided, Model-Agnostic Agent Protocol for Auditable Hypothesis-Driven Decision Making

Abstract: What binds large language models on auditable, hypothesis-driven decision tasks, where every candidate can be checked against the evidence? On the public TCMEval-SDT benchmark for Traditional Chinese Medicine syndrome differentiation (200 cases), the binding constraint is output discipline and reasoning structure, not model capability alone: two years of model scaling move zero-shot scores by only -0.03 to +0.08, while output-discipline failures (non-terminating reasoning, format non-compliance, large run-to-run spread) persist even in frontier models. We test this with a model-agnostic agent framework formalizing decision making as a five-stage closed loop, enforced by a candidate x evidence matrix falsification protocol: every candidate is judged against every evidence item, at least half of the candidates must be falsified before a conclusion is licensed, and survivors are emitted in a machine-verifiable single-line format. Across five base models, the effect is sign-conditional on zero-shot output discipline: it rescues models whose discipline fails (DeepSeek-V4-Flash: +0.267/+0.271, entirely termination rescue), reduces a high-variance model's run-to-run standard deviation from 0.218 to 0.007 (Kimi K3), and significantly costs already-disciplined models (-0.087 to -0.120 on budget-matched Qwen3-4B/32B). Ablations attribute the cost to the candidate-bounded format layer and show the effect is independent of injected knowledge content (protocol-knowledge decoupling). The protocol also transfers to misinformation-robust mathematical reasoning, detecting injected false premises at 89.8% recall with a 6.8% false-positive rate (MCC 0.54; a flag-everything baseline scores 0) and restoring accuracy to the no-misinformation ceiling. Where zero-shot output discipline is weak, the reasoning protocol sets the floor; base-model capability always sets the ceiling.

Tue 13 OctArtificial Intelligence
The gist
Making decisions based on evidence can be tricky, especially for AI models that sometimes produce messy or inconsistent answers. This paper shows that the way AI outputs are structured and disciplined matters more than how powerful the model itself is. The authors designed a step-by-step process that forces AI to judge each possible answer against all the evidence, helping catch mistakes and improve reliability. This method helps some weaker models perform better and makes reasoning more transparent, even spotting false information in math problems.
Open → 2610.18298v1