AI shifts science limits from knowledge to evidence and validation
When Scientific Cognition Is No Longer Scarce
Computers and SocietyArtificial Intelligence
Summary
Science has always been slowed down by how hard it is to think up new ideas and check them thoroughly. The authors imagine a future where computers do almost all scientific thinking quickly and cheaply, but actual experiments and trustworthy proof remain hard to get. In that world, science won’t be limited by ideas or analysis but by how well we can test and verify those ideas. They explore how this shift affects what resources matter most for scientific progress.
What this means in practice
- •For national laboratory managers: Redesign processes to integrate abundant AI-generated outputs with scarce experimental validation and expert oversight.
- •For software engineers in scientific computing: Develop tools focusing on managing scarce experimental data and ensuring provenance when AI systems generate hypotheses and analyses.
A position paper. It proposes an approach and reports no results.
Authors
Nathan DeBardeleben
Abstract
AI could change which parts of science impede progress. Consider a world in which machine systems are better, faster, and cheaper than people at most scientific work that can be done through a computer. Our question is what would limit science in that world. Literature synthesis, hypothesis generation, software development, simulation, and analysis could become abundant, while experiments, observations, well-supported conclusions, and accountable institutional au- thority remain scarce. Science would then be constrained by a different set of resources. In this paper, we call this change the scarcity inversion and consider four parts of it: selection, physical access, validation, and organizational choice. This change is arriving first in mathematics and coding/software/algorithm design, where the whole scientific loop can run inside computation. For national laboratories, the change could be striking. Their distinctive role is to turn abundant machine reasoning into trustworthy results by combining controlled experiments, protected data, expert judgment, and accountable authority. The practical question is how facilities, verification, provenance, resource allocation, and scientific governance should change when reasoning is plentiful and trustworthy evidence is scarce.