Papers for

utility data teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Data repair improves AI demand forecasts for US building electricity

Validated Data Onboarding for AI Demand Forecasting on U.S. Building Meter Data: Design, Controlled Evaluation, and a Corrected Negative Result

Abstract: Electric utilities and grid operators increasingly rely on machine-learning models to forecast next-day demand, and those models learn from meter data that is routinely defective: readings go missing, sensors freeze, buildings read zero for hours, and units change by a factor of 100. This report presents a data-onboarding pipeline that detects and repairs such defects before a model is trained, using only information available at forecast time, and a controlled experiment that measures whether the pipeline protects a 24-hour-ahead forecast. On hourly electricity data for twelve U.S. buildings from the public Building Data Genome 2 dataset (210,528 rows, 2016-2017), seeded, hash-logged defects touching 0.10% of the training period raised the error of a gradient-boosting forecaster by 86%; after detection and past-only repair the error returned to the clean-data level (mean absolute scaled error 0.760 clean, 1.415 corrupted, 0.729 repaired) while 93% of training targets were retained. At a defect prevalence calibrated to published field studies (1.6% of training rows) the unprotected forecaster's error reached 4.4 times that of a seasonal-naive rule, and the repaired forecaster again matched the clean baseline. The same pattern held for ridge regression and a random forest and across horizons of 1 to 24 hours. A first version of the pipeline over-cleaned natural data and made forecasts 25% worse; that result is retained, its cause is traced in the published artifacts, and the per-building calibration that corrects it is documented as a dated amendment. Every number is reproducible from pinned public inputs with SHA-256 verification, 84 automated tests and continuous integration.

Thu 1 OctMachine Learning
The gist
Electric meters in buildings often report faulty data that can confuse AI models predicting electricity use the next day. The authors built a system that finds and fixes these errors using only data available at forecast time. They tested it on real electricity data from twelve buildings and showed that fixing errors greatly improved prediction accuracy. They also found that their first version sometimes removed too much data, making forecasts worse, and shared how they fixed it. All results can be checked and repeated with public data and code.
Open → 2610.02397v1

Small language models improve power outage report accuracy with risk training

Enhancing Small Language Models for Power Outage Report Generation via Minimum Risk Training

Abstract: Minimum Risk Training (MRT) enables neural machine translation models to directly optimize sequence-level evaluation metrics instead of relying only on token- level maximum-likelihood objectives Shen et al. [2016]. Although introduced a decade ago, recent work shows renewed potential for risk-based optimization in modern language models Yang et al. [2024], Jinnai et al. [2025]. We apply MRT to power outage report generation for the Outage Data Initiative Nationwide (ODIN), transforming heterogeneous reports into standardized XML compliant with CIM IEC 61968-3. Our MRT approach improves Qwen2.5-7B-Instruct overall accuracy from 16.20% to 68.95%, demonstrating the effectiveness of sequence- level optimization for domain-specific structured generation

Wed 23 SeptArtificial Intelligence
The gist
Power outages can generate messy reports that are hard to use. The authors improved a smaller language model so it better converts these reports into a neat, standardized format. They used a method called Minimum Risk Training, which helps the model focus on producing better overall reports, not just guessing one word at a time. This made the model much more accurate when creating these structured reports.
Open → 2609.27197v1