Papers for

data center planners

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

3D scaling reduces GPU carbon footprint compared to 2.5D scaling

Embodied Emissions of 2.5D and 3D Scaling in Chipletized GPUs for Low-Carbon AI

Abstract: GPU compute resources are scaling to support growing AI workloads, leading to further rises in the climate change impact of hyperscale data centers that rely on high-performance GPUs. To model how packaging decisions impact the carbon footprint we have estimated the embodied emissions (EE) of a chiplet-based GPU that has been scaled in 2.5D and 3D using the imec.netzero modelling platform. We doubled the number of compute units and high bandwidth memory (HBM) capacity in the 2.5D and 3D scaled systems and found that 3D scaling results in an 89% increase in EE, as compared to an increase of 141% for 2.5D scaling, positioning 3D scaling as an attractive solution to limit the embodied emissions due to GPU scaling.

Fri 23 OctHardware Architecture
The gist
As GPUs grow more powerful to support AI, they use more materials that impact the environment. The authors looked at two ways to stack components inside GPUs, called 2.5D and 3D, to see which has a smaller carbon footprint. They found that 3D stacking increases environmental impact less than 2.5D when doubling key parts of the GPU. This means 3D scaling could help make future GPUs greener while still growing in power.
Open → 2610.32830v1

AI data center planning faces challenges in tracking decision impacts

Watts If? A Benchmark for Counterfactual Reasoning About the AI Data Center Buildout

Abstract: An AI data center is committed years before it draws a watt: a few discrete choices (grid or on-site gas, evaporative or dry cooling, which county to file in) fix its capital, water draw, and carbon path, and LLMs are now asked to help screen them with no test of whether they track what each commitment rules out. We introduce DCBench-440, with two arms reported separately: 200 generative questions over STRIPS worlds for five US deal archetypes, with search-verified gold answers and no tested shortcut above 12% on any question type, and 240 multiple-choice questions grounded in quoted site records, emission equations, and stated scenarios. Across open-weight deployments, accuracy spans 12.5-71.5% (generative) and 58.3-92.5% (multiple choice). One skill fails everywhere: asked to list every action available at a decision gate, no model exceeds 4.0% exact match. The strongest list 72-85% of the actions that would change the project's state but omit most permitted actions that change nothing; with those excused, the best exact match is still 24%. Code, data, and other materials are available upon request.

Thu 15 OctArtificial Intelligence
The gist
Planning an AI data center involves many early decisions that determine its energy use and emissions, but current language models struggle to understand all the consequences of these choices. The authors created DCBench-440, a new test with many questions about real and simulated data center planning scenarios, to see how well AI can reason about these decisions. They found that models often miss important actions and fail to list all possible choices, showing limits in AI reasoning for this area. This benchmark helps measure progress in teaching AI to better understand complex planning commitments.
Open → 2610.21397v1

Data center cooling choices shift water use across regions and time

Data center cooling choices shift water impacts across the grid: An integrated water-energy model for sustainable data center development

Abstract: Data centers are being developed at an unprecedented pace, yet their energy and water impacts, and the spatial and temporal distribution of these impacts, remain poorly characterized. Data centers consume water for cooling (direct) and through electricity generation (indirect). Decisions on siting and cooling technology result in water-energy trade-offs that extend impacts beyond the facility's location. Existing assessment frameworks rely on facility efficiency metrics and average grid water intensity factors, suppressing the temporal impacts of data center load and generation availability. They also attribute indirect consumption to the facility's location rather than to the generators (and corresponding hydrologic regions) that respond to the added load, misattributing spatial impacts. To close this gap, we develop a computational model of the data center-energy-water nexus that links facility cooling and electricity demand with hourly economic dispatch, generator-level water consumption, and monthly subbasin depletion. Built on open-source data, the model resolves where and when water is consumed, and where this consumption compounds existing water risk or creates new risk. Using the model, we study different cooling configurations and proposed developments in the state of Michigan. Air-cooled data centers halve total water consumption relative to evaporative cooling, but increase electricity demand and raise indirect water consumption by one-third, shifting the water footprint from the facility to generators. Mapping these changes to subbasins reveals depletion increases beyond the data center sites, in regions that facility-level reporting may overlook. These results show that data center water and energy impacts cannot be assessed in isolation, motivating the need for integrated modeling to inform siting, design, and reporting practices.

Mon 21 SeptComputers and SocietyDistributed, Parallel, and Cluster Computing
The gist
Data centers need lots of water for cooling and electricity generation, but the full picture of where and when this water is used isn’t well understood. The authors created a model that tracks both the direct water used on site and the indirect water used by power plants supplying electricity. They found that choosing air cooling over evaporative cooling cuts water use at the data center but increases electricity use, shifting water consumption to different locations and times. This means water impacts must be studied beyond the data center itself to make smarter decisions about where and how to build and cool these facilities.
Open → 2609.25437v1

Artificial intelligence data centers face power supply challenges

AI for AI: Optimizing Additional Infrastructure Build-out to Power Artificial Intelligence Data Centers

Abstract: The twenty-first century's transformative technology, artificial intelligence, is increasingly constrained by the twentieth century's transformative technology, the electricity grid. Rapid growth in electricity demand from data centers is leading to higher electricity prices, without a compensating supply-side response. We develop a framework linking data-center load growth, available generation capacity, and market-clearing prices to understand this phenomenon. We first analyze a deterministic model to show how differing estimates of demand and supply growth rates affect prices. We then model the expansion of new data centers and their associated electricity demand, together with build-outs of new electricity supply, as stochastic processes,resulting in probabilistic distributions of supply, demand, and prices rather than a single forecast. Finally, we formulate generation expansion as a stochastic control problem in which a revenue-maximizing investor dynamically chooses the intensity of supply-side investments. The analysis highlights a central challenge of the data-center build-out: even when rapid demand growth increases the need for new generation, the uncertainties related to load forecasts, development execution risks, and value cannibalization from overbuilding capacity may weaken incentives to invest at the pace required to keep electricity prices stable.

Tue 8 SeptArtificial Intelligence
The gist
Data centers needed for AI are growing quickly and need more electricity. This growth is causing electricity prices to rise because the power grid isn’t adding new capacity fast enough. The researchers created a model that looks at how supply and demand for electricity might change in uncertain ways and how investors decide when to build new power plants. They found that uncertainty about future electricity needs and risks can make investors hesitant, which could lead to higher prices or shortages.
Open → 2609.08166v1