Selective Time Series Forecasting via Metalearning
2026-06-22 • Machine Learning
Machine Learning
AI summaryⓘ
The authors studied how deep learning models sometimes struggle to predict certain time series data accurately. They introduced a new method that helps the model decide when to avoid making a prediction it might get wrong. Instead of relying on confidence measures tied to the training data, their method uses general features from recent data patterns to judge difficulty. This makes the system better at choosing when to reject predictions, even on very different types of data, improving overall accuracy.
deep learningtime series forecastingreject optionabstentionmetalearningtransfer learningprediction intervalforecast errorscale-invariant statistics
Authors
Ricardo Inácio, Vitor Cerqueira, Marília Barandas, Carlos Soares
Abstract
Deep learning methods have achieved state-of-the-art in time series forecasting, yet their accuracy varies considerably across samples, as some instances remain inherently difficult to predict. Reject option mechanisms, which allow models to abstain from high-risk predictions, are well established in classification and regression but underexplored in forecasting. Existing abstention strategies typically rely on proxies, such as the width of the prediction interval or learned confidence scores derived from forecasts. However, these approaches are inherently tied to the training domain, limiting their ability to generalize. We propose a selective forecasting framework that addresses this limitation by modeling the empirical percentile of forecasting errors, that is, a scale-invariant statistic, based on structural characteristics extracted from recent lags via metalearning. By decoupling the rejection decision from the forecast itself and grounding it in domain-agnostic features, the framework enables effective abstention transfer across heterogeneous time series. Experiments in both in-domain and transfer learning settings show that rejecting samples predicted as challenging consistently improves forecasting accuracy across coverage levels.