Frontend
EnergyBench: a live, gate-aligned benchmark of day-ahead forecasts for European power markets
arXiv eess.SY0 views
arXiv:2611.07784v1 Announce Type: cross Abstract: Energy forecasting models are usually compared on backtests and fixed public datasets. Backtests can use data that did not yet exist when the forecast would have been made, and a fixed test set, reused across studies and possibly contained in the pretraining data of foundation models, invites overfitting to the benchmark. EnergyBench evaluates every entry live instead. Each day at 11:30 CET/CEST, thirty minutes before the day-ahead (SDAC) gate closes, every model forecasts the next day's price, wind and solar generation and load on the 15-minute grid for six bidding zones (BE, NL, FR, DE-LU, DK1, DK2). Unlike existing live benchmarks, EnergyBench runs the models itself, on one information set that it freezes at the cut-off and publishes, including three numerical weather prediction models, so that foundation models can be compared with and without the same weather covariates under the actual market deadline. Errors are pooled per series against a seasonal-naive baseline, and models are ranked by a Bradley-Terry rating on the Elo scale with a day-bootstrap interval. The field spans baselines, linear and gradient-boosted models on the frozen weather, eighteen time-series foundation models from eleven families, ensembles, and the grid operators' own forecasts. Over the first thirty-two live days, the covariates reduced the error of each of the ten foundation models run with and without them by 37-51% on matched races (64-73% on wind, 48-61% on solar). Used zero-shot, these models match or outperform a LightGBM model trained on the same covariates. Model size, from 3M to 331M parameters, has a much smaller effect, and median ensembles of the covariate models rank highest. The grid operators' pre-gate forecasts remain ahead on wind and solar, where the best single foundation models have 16-22% more error; on load the gap is 4-6%, within the intervals.
Source:https://arxiv.org/abs/2611.07784PreviousOnline Optimization for Controlling HVAC SystemsNextOn the Spectral Dependence of Decentralized Stochastic Gradient Tracking
Related posts
마이크로드라마 열풍 속 '눈 건강'의 역설, Amblyotube가 제시하는 새로운 해법 — 개발자이자 약시 경험자의 시선에서
0dev.to
Reconcile an email research batch before comparing providers
0dev.to
They don't make 'em like that any more: Borland Turbo Pascal 7
0Hacker News
Institute for Advanced Study's Electronic Computer Project (1946 – 1954)
0Hacker News New
Why the Fascination with Retrocomputing?
0Hacker News New

Auditing 3,300 Files and 153 Claude Code & Codex Logs: Why 39.0% of Agent Functions Are Written Without Searching the Repo
0dev.to