Agentic AI strategies trade off accuracy and carbon emissions
Toward Sustainable Agentic AI: Carbon Tradeoffs Across Iterative Self-Refinement and Tool-Augmented Coding
Artificial Intelligence
Summary
Agentic AI systems can improve their answers either by checking and refining their own responses multiple times, or by using external tools like code execution environments. The authors studied how these approaches affect the AI's accuracy and its carbon footprint, which measures environmental impact. They found that while iterative self-refinement can greatly improve accuracy, it also increases carbon emissions nearly threefold. Using more advanced AI with tool use improved success rates but sometimes at higher carbon costs. These results help understand the environmental effects of different ways to improve AI responses.
What this means in practice
- •For software development teams: Measure and optimize the carbon cost of AI-assisted coding tools that refine code and use tool-based execution to improve success rates.
- •For cloud infrastructure managers: Balance AI inference workloads and iteration strategies to reduce environmental impact while maintaining performance in AI-powered services.
Authors
Boris Ruf, Adrien de Mailly Nesle, Marcin Detyniecki
Abstract
Agentic language model systems can improve performance either by iterating on their own outputs or by using external tools in grounded environments. While these strategies can reduce error rates and substitute for larger models in some settings, their environmental cost remains relatively underexplored. We present two complementary empirical studies that estimate the energy and carbon footprint of agentic AI across settings of increasing complexity. Study~1 evaluates iterative verbal self-refinement: GPT-4.1-mini at $k = 1$--$5$ steps versus a GPT-4.1 single-pass baseline on two MATH benchmark splits. Study~2 evaluates tool-augmented agentic coding: GPT-4.1-mini, Claude Opus~4.6, and GPT-5.3-codex on SWE-bench Lite, where agents operate inside Docker-isolated environments with access to code execution and file editing tools. In Study~1, $k=3$ refinements close a 16-percentage-point accuracy gap to within 1~point, but nearly triple the carbon footprint relative to the cheap single-pass baseline while remaining below the GPT-4.1 single-pass baseline under the current token-based carbon scenario. In Study~2, GPT-5.3-codex achieves the highest resolution rate in this sample (81.2\%), ahead of Claude Opus~4.6 (68.9\%) and GPT-4.1-mini (25.0\%), but resolved-task-normalized efficiency remains mixed: GPT-4.1-mini is lowest on estimated carbon and cost per resolved task, while GPT-5.3-codex delivers substantially higher task success. All carbon estimates cover output-token inference only; prompt tokens, which exceed 99\% of tokens in Study~2, and tool execution are not charged, so the figures are lower bounds on the full agentic footprint.