Simulation reveals key forces shaping academic research ecosystems
Science Utopia? Closed-Loop LLM Simulation of Academic Research Ecosystems
Computation and LanguageArtificial IntelligenceComputers and Society
Summary
Scientific progress depends on many things working together, like researchers, institutions, funding, and peer review. The authors created a simulation, called SciUtopia, that models these parts and how they change over time using AI language models. Their simulation shows how the process of resubmitting rejected papers increases reviewer workload, how cautious research exploration helps both careers and long-term idea diversity, and how inequality in resources can appear even without early funding advantages. This tool helps study complex academic systems by testing how different factors interact.
What this means in practice
- •For science policy analysts: Assess how funding policies and peer review practices impact research diversity and reviewer workload over years using simulated academic ecosystems.
- •For academic institution planners: Model and predict effects of institutional changes on researcher careers and publication dynamics through long-term simulation of research ecosystems.
Authors
Yiqiao Jin, Yiyang Wang, Lucheng Fu, Bing He, Siheng Xiong, Yijia Xiao, B. Aditya Prakash, Josiah Hester, Srijan Kumar, James Evans, Jindong Wang
Abstract
Scientific progress emerges from a longitudinal ecosystem in which researchers, institutions, funding agencies, collaboration networks, and the scientific literature co-evolve. As AI becomes increasingly involved throughout the scientific research cycle, understanding these interconnected and evolving processes becomes increasingly important. We introduce SciUtopia, a persistent, closed-loop LLM-agent simulation framework for studying academic research ecosystems. SciUtopia models interconnected scientific processes such as research-direction choice, collaboration, submission, peer review, resubmission, citation, funding, and researcher attrition, while maintaining evolving states across simulated years. Its configurable institutional mechanisms and information channels provide a controlled testbed for matched counterfactual experiments and targeted interventions. Across 61 simulation worlds, SciUtopia simulates over 40,000 researchers from 8,000 institutions, producing around 400,000 publication decisions and 1.2 million LLM-generated peer reviews. Using these longitudinal simulations, we find that rejection-driven resubmission substantially amplifies reviewer burden beyond population growth alone, cautious exploration balances citation impact with career success and long-term topic diversity, and resource inequality can emerge even without detectable cumulative advantage from narrowly winning early funding. Code is available at https://github.com/Ahren09/ScienceUtopia.