Papers for
research funding agencies
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Longstanding problems in measuring research impact by country
On some unresolved issues in aggregate level comparative research evaluation
Abstract: This short conceptual paper recalls to the attention of the scientometrics community some long-standing open methodological problems and proposes new directions that might be taken in renewed engagements with them. These problems are the differential dependency of the global reference score on the included units' observed scores and the dilution of impact measurement accuracy due to collaboration, which causes a global convergence in country citation impact due to international collaborative research. Advantages and disadvantages of existing and new solutions are discussed.
Scientific impact prediction adapts to diverse evidence and contexts
LLM4Impact: Integrating Heterogeneous Information for Scientific Impact Prediction
Abstract: Predicting the future impact of a newly published paper is challenging because it must be inferred from heterogeneous evidence available at publication time. Existing approaches often rely on a single source of information or combine multiple sources without accounting for their different predictive roles. In this paper, we present LLM4Impact, an evidence-aware method for scientific impact prediction that learns to represent, integrate, and calibrate heterogeneous information. LLM4Impact combines semantic, graph, LLM, and temporal representations, and injects graph information into a frozen LLM through continuous prefix tokens. A context aware gating mechanism adaptively weights different evidence, while a separate calibration module accounts for domain and temporal variation in citation scales. We further construct a large-scale benchmark dataset with 2 million papers, leakage-safe point-in-time heterogeneous ego graphs, temporal splits, and both year-level and month-level citation targets. Experiments show that LLM4Impact consistently outperforms strong semantic, graph, and LLM based baselines, with a 10.13% reduction in year RMSE on the in distribution test set and a 6.87% reduction under out-of-domain distribution. Our results reveal that the value of such evidence is context dependent: different papers benefit from different sources, while domain and publication time affect how evidence translates into citations. This finding motivates adaptive evidence selection and context-conditioned calibration rather than simply richer representations. We will release our code, benchmark, and an interactive web demonstration upon publication.
Estonia’s research funding shifted towards dual-use tech after 2014 conflict
Shifting Research Funding Priorities under Geopolitical Pressure: Evidence from Estonia
Abstract: This study examines how the 2014 Donbas-war breakpoint was associated with changes in the semantic composition of research funding recorded in Estonia, a geopolitically exposed country outside the belligerent states. It combines 17,952 research-funding records from the Estonian Research Information System (ETIS) for 2000 to 2019 with a field-by-year matched OpenAlex reference corpus and geocoded Donbas conflict records. Contrastive text projections distinguish explicit-war language from dual-use technological orientation and eight crisis-relevant capability channels, allowing shifts to be detected beyond projects that directly mention war or security. Segmented annual models show positive post-2014 slope changes in dual-use and maximum-capability measures, whereas explicit-war language follows a different trajectory. Financing-weighted estimates identify positive post-2014 level differences among larger recorded projects. Capability-channel comparisons indicate the strongest positive period differences in computer science, energy, and engineering, together with a temporary narrowing of the capability profile. The results suggest that a neighboring research system can register geopolitical pressure through changes in the technical and preparedness-oriented language of funded projects. More broadly, the study demonstrates how project-level semantic evidence can reveal shifts in public science-funding priorities that remain difficult to observe through disciplinary classifications or explicit conflict terminology alone.
Scientific talent stays focused despite broader team collaborations
Has Scientific Talent Shifted from Depth to Breadth?Evidence across Papers, Knowledge Inputs, Careers, and Teams
Abstract: Generative artificial intelligence raises a central question for scientific training and organization. Is research shifting from deep specialization toward broad individual knowledge? We examine this proposition across papers, cited knowledge, contributor histories, and teams using 47,959 articles from six fields over 2010-2025, 51,736 resolved cited works, and chronologically reconstructed prior publication histories for 1,754 randomly selected index contributors. From 2010 to 2022, team size increased by an estimated 37.3% (95% confidence interval [34.4%, 40.3%]), while paper topic breadth declined by 0.0144 on a 0-1 hierarchical distance scale. Cited knowledge was stable to modestly broader, revealing a divergence between focused outputs and the reach of knowledge inputs. Established contributors' prior breadth increased by 0.0190 [-0.0078, 0.0459] by 2019-2022, within a +/-0.05 equivalence bound assessed in sensitivity analysis. In mature citation windows, one standard deviation of focal depth was associated with 8.2% higher 1 + FWCI [1.9%, 14.9%]; average breadth and interaction associations were smaller under the specified equivalence bounds. Post-2022 deviations from earlier trends were not systematic, and recent changes did not vary clearly with baseline AI intensity across 83 subfields. The findings support a differentiated structure of scientific expertise in which focused individual accumulation coexists with expanding collaboration and sustained access to diverse knowledge inputs.