Quantile regression averaging
≈ 3 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Quantile Regression Averaging (QRA) is a forecast combination approach to the computation of prediction intervals. It involves applying quantile regression to the point forecasts of a small number of individual forecasting models or experts. It has been introduced in 2014 by Jakub Nowotarski and Rafał Weron and originally used for probabilistic forecasting of electricity prices and loads. Despite its simplicity it has been found to perform extremely well in practice - the top two performing teams in the price track of the Global Energy Forecasting Competition (GEFCom2014) used variants of QRA.
Quantile Regression Averaging (QRA) is a forecast combination approach to the computation of prediction intervals. It involves applying quantile regression to the point forecasts of a small number of individual forecasting models or experts. It has been introduced in 2014 by Jakub Nowotarski and Rafał Weron and originally used for probabilistic forecasting of electricity prices and loads.
Despite its simplicity it has been found to perform extremely well in practice - the top two performing teams in the price track of the Global Energy Forecasting Competition (GEFCom2014) used variants of QRA. Q_y(q|X_t) = X_t\beta_q , where Q_y(q | \cdot) is the conditional q-th quantile of the dependent variable ( y_t ), X_t=[1,\hat{y}_{1,t},...,\hat{y}_{m,t}] is a vector of point forecasts of m individual models (i.e. independent variables) and β q is a vector of parameters (for quantile q).
The parameters are estimated by minimizing the loss function for a particular q-th quantile: \min\limits_{\beta_q} \left[ \sum\limits_{\{t:y_t \geq X_t\beta_q \}} q |y_t - X_t\beta_q | + \sum\limits_{\{t:y_t QRA assigns weights to individual forecasting methods and combines them to yield forecasts of chosen quantiles.
How it works
Although the QRA method is based on quantile regression, not least squares, it still suffers from the same problems: the exogenous variables should not be correlated strongly and the number of variables included in the model has to be relatively small in order for the method to be computationally efficient. In Factor Quantile Regression Averaging (FQRA), instead of selecting individual models a priori, the relevant information contained in all forecasting models at hand is extracted using principal component analysis (PCA).
The prediction intervals are then constructed on the basis of the common factors ( f_t ) obtained from the panel of point forecasts, as independent variables in a quantile regression. More precisely, in the FQRA method X_t=[1,\hat{f}_{1,t},...,\hat{f}_{k,t}] is a vector of k factors extracted from a panel of point forecasts of m individual models, not a vector of point forecasts of the individual models themselves.
Background
A similar principal component-type approach was proposed in the context of obtaining point forecasts from the Survey of Professional Forecasters data. Instead of considering a (large) panel of forecasts of the individual models, FQRA concentrates on a small number of common factors, which - by construction - are orthogonal to each other, and hence are contemporaneously uncorrelated. FQRA can be also interpreted as a forecast averaging approach.
The factors estimated within PCA are linear combinations of individual vectors of the panel and FQRA can therefore be used to assign weights to the forecasting models directly.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1324711147 under CC BY-SA 4.0; modifications have been made.