Regression-kriging

In applied statistics and geostatistics, regression-kriging (RK) is a spatial prediction technique that combines a regression of the dependent variable on auxiliary variables (such as parameters derived from digital elevation modelling…

Uses your system voice; voice and rate in settings.

Snapshot

≈ 9 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

In applied statistics and geostatistics, regression-kriging (RK) is a spatial prediction technique that combines a regression of the dependent variable on auxiliary variables (such as parameters derived from digital elevation modelling, remote sensing/imagery, and thematic maps) with interpolation (kriging) of the regression residuals. It is mathematically equivalent to the interpolation method variously called universal kriging and kriging with external drift, where auxiliary predictors are used directly to solve the kriging weights.

Z(\mathbf{s}) = m(\mathbf{s}) + \varepsilon '(\mathbf{s}) + \varepsilon which he termed universal model of spatial variation. Both deterministic and stochastic components of spatial variation can be modeled separately.

By combining the two approaches, we obtain: \hat z(\mathbf{s}_0 ) = \hat m(\mathbf{s}_0 ) + \hat e(\mathbf{s}_0 )= \sum\limits_{k = 0}^p {\hat \beta _k \cdot q_k (\mathbf{s}_0 )} + \sum\limits_{i = 1}^n \lambda_i \cdot e(\mathbf{s}_i ) where \hat m(\mathbf{s}_0) is the fitted deterministic part, \hat e(\mathbf{s}_0) is the interpolated residual, \hat \beta _k are estimated deterministic model coefficients ( \hat \beta _0 is the estimated intercept), \lambda_i are kriging weights determined by the spatial dependence structure of the residual and where e(\mathbf{s}_i) is the residual at location {\mathbf{s}}_i . The regression coefficients \hat \beta _k can be estimated from the sample by some fitting method, e.g. ordinary least squares (OLS) or, optimally, using generalized least squares (GLS): \mathbf{\hat \beta }_\mathtt{GLS} = \left( \mathbf{q}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{q} \right)^{ - \mathbf{1}} \cdot \mathbf{q}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{z} where \mathbf{\hat \beta}_\mathtt{GLS} is the vector of estimated regression coefficients, \mathbf{C} is the covariance matrix of the residuals, {\mathbf{q}} is a matrix of predictors at the sampling locations and \mathbf{z} is the vector of measured values of the target variable. The GLS estimation of regression coefficients is, in fact, a special case of the geographically weighted regression.

In the case, the weights are determined objectively to account for the spatial auto-correlation between the residuals. Once the deterministic part of variation has been estimated (regression-part), the residual can be interpolated with kriging and added to the estimated trend.

The estimation of the residuals is an iterative process: first the deterministic part of variation is estimated using OLS, then the covariance function of the residuals is used to obtain the GLS coefficients. Next, these are used to re-compute the residuals, from which an updated covariance function is computed, and so on.

Although this is by many geostatisticians recommended as the proper procedure, Kitanidis (1994) showed that use of the covariance function derived from the OLS residuals (i.e. a single iteration) is often satisfactory, because it is not different enough from the function derived after several iterations; i.e. it does not affect much the final predictions. Minasny and McBratney (2007) report similar results—it seems that using more higher quality data is more important than to use more sophisticated statistical methods.

In matrix notation, regression-kriging is commonly written as: \hat z_\mathtt{RK}(\mathbf{s}_0 ) = \mathbf{q}_\mathbf{0}^\mathbf{T} \cdot \mathbf{\hat \beta}_\mathtt{GLS} + \mathbf{\lambda }_\mathbf{0}^\mathbf{T} \cdot (\mathbf{z} - \mathbf{q} \cdot \mathbf{\hat \beta }_\mathtt{GLS} ) where \hat z({\mathbf{s}}_0 ) is the predicted value at location {\mathbf{s}}_0 , {\mathbf{q}}_{\mathbf{0}} is the vector of p+1 predictors and \mathbf{\lambda}_{\mathbf{0}} is the vector of n kriging weights used to interpolate the residuals. The RK model is considered to be the Best Linear Predictor of spatial data.

It has a prediction variance that reflects the position of new locations (extrapolation) in both geographical and feature space: \hat \sigma_\mathtt{RK}^2 (\mathbf{s}_0) = (C_0 + C_1 ) - \mathbf{c}_\mathbf{0}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{c}_\mathbf{0} + \left( \mathbf{q}_\mathbf{0} - \mathbf{q}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{c}_\mathbf{0} \right)^\mathbf{T} \cdot \left( \mathbf{q}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{q} \right)^\mathbf{ - 1} \cdot \left(\mathbf{q}_\mathbf{0} - \mathbf{q}^\mathbf{T} \cdot \mathbf{C}^{ - \mathbf{1}} \cdot \mathbf{c}_\mathbf{0} \right) where C_0 + C_1 is the sill variation and {\mathbf{c}}_0 is the vector of covariances of residuals at the unvisited location. Many (geo)statisticians believe that there is only one Best Linear Unbiased Prediction model for spatial data (e.g. regression-kriging), all other techniques such as ordinary kriging, environmental correlation, averaging of values per polygons or inverse distance interpolation can be seen as its special cases.

If the residuals show no spatial auto-correlation (pure nugget effect), the regression-kriging converges to pure multiple linear regression, because the covariance matrix ( \mathbf{C} ) becomes an identity matrix. Likewise, if the target variable shows no correlation with the auxiliary predictors, the regression-kriging model reduces to ordinary kriging model because the deterministic part equals the (global) mean value.

Hence, pure kriging and pure regression should be considered as only special cases of regression-kriging (see figure). \hat{z}_\mathtt{KED} (\mathbf{s}_0 ) = \sum\limits_{i = 1}^n w_i^\mathtt{KED} (\mathbf{s}_0 ) \cdot z(\mathbf{s}_i ) for \sum\limits_{i = 1}^n w_i^\mathtt{KED} (\mathbf{s}_0 ) \cdot q_k (\mathbf{s}_i ) = q_k (\mathbf{s}_0 ) for k = 1,\ldots,p or in matrix notation: \hat z_\mathtt{KED} (\mathbf{s}_0 ) = \mathbf{\delta}_\mathbf{0}^\mathbf{T} \cdot \mathbf{z} where z is the target variable, q_k 's are the predictor variables i.e. values at a new location ({\mathbf{s}}_0) , {\mathbf{\delta }}_{\mathbf{0}} is the vector of KED weights ( w_i^{\mathtt{KED}} ), p is the number of predictors and \mathbf{z} is the vector of n observations at primary locations. The KED weights are solved using the extended matrices: \mathbf{\lambda }_\mathbf{0}^\mathtt{KED} = \left\{ w_1^\mathtt{KED} (\mathbf{s}_0 ), \ldots ,w_n^\mathtt{KED} (\mathbf{s}_0 ),\varphi_0 (\mathbf{s}_0 ), \ldots ,\varphi _p (\mathbf{s}_0 ) \right\}^\mathbf{T} = \mathbf{C}^{\mathtt{KED} -1} \cdot \mathbf{c}_\mathbf{0}^\mathtt{KED} where {\mathbf{\lambda }}_{\mathbf{0}}^{\mathtt{KED}} is the vector of solved weights, \varphi _p are the Lagrange multipliers, {\mathbf{C}}^{\mathtt{KED}} is the extended covariance matrix of residuals and {\mathbf{c}}_{\mathbf{0}}^{\mathtt{KED}} is the extended vector of covariances at new location.

In the case of KED, the extended covariance matrix of residuals looks like this (Webster and Oliver, 2007; p. 183): \mathbf{C}^\mathtt{KED} = \left[ \begin{array}{ccccccc} C(\mathbf{s}_1 , \mathbf{s}_1) & \cdots & C(\mathbf{s}_1, \mathbf{s}_n ) & 1 & q_1 (\mathbf{s}_1 ) & \cdots & q_p (\mathbf{s}_1 ) \\ \vdots & & \vdots & \vdots & \vdots & & \vdots \\ C(\mathbf{s}_n, \mathbf{s}_1 ) & \cdots & C(\mathbf{s}_n ,\mathbf{s}_n ) & 1 & q_1 (\mathbf{s}_n ) & \cdots & q_p (\mathbf{s}_n ) \\ 1 & \cdots & 1 & 0 & 0 & \cdots & 0 \\ q_1 (\mathbf{s}_1 ) & \cdots & q_1 (\mathbf{s}_n ) & 0 & 0 & \cdots & 0 \\ \vdots & & \vdots & \vdots & \vdots & & \vdots \\ q_p (\mathbf{s}_1 ) & \cdots & q_p (\mathbf{s}_n ) & 0 & 0 & \cdots & 0 \end{array} \right] and \mathbf{c}_{\mathbf{0}}^{\mathtt{KED}} like this: \mathbf{c}_\mathbf{0}^\mathtt{KED} = \left\{ C(\mathbf{s}_0, \mathbf{s}_1 ), \ldots , C(\mathbf{s}_0, \mathbf{s}_n ), q_0 (\mathbf{s}_0 ), q_1 (\mathbf{s}_0 ), \ldots ,q_p (\mathbf{s}_0 ) \right\}^\mathbf{T}; q_0 (\mathbf{s}_0 ) = 1 Hence, KED looks exactly as ordinary kriging, except the covariance matrix/vector are extended with values of auxiliary predictors. Although the KED seems, at first glance, to be computationally more straightforward than RK, the parameters of the variogram for KED must also be estimated from regression residuals, thus requiring a separate regression modelling step.

This regression should be GLS because of the likely spatial correlation between residuals. Note that many analyst use instead the OLS residuals, which may not be too different from the GLS residuals.

However, they are not optimal if there is any spatial correlation, and indeed they may be quite different for clustered sample points or if the number of samples is relatively small ( \ll 200 ). A limitation of KED is the instability of the extended matrix in the case that the covariate does not vary smoothly in space.

RK has the advantage that it explicitly separates trend estimation from spatial prediction of residuals, allowing the use of arbitrarily-complex forms of regression, rather than the simple linear techniques that can be used with KED. In addition, it allows the separate interpretation of the two interpolated components.

The emphasis on regression is important also because fitting of the deterministic part of variation (regression) is often more beneficial for the quality of final maps than fitting of the stochastic part (residuals). Interpolation set (point map) — z(\mathbf{s}_i) i=1,\ldots ,n at primary locations; Minimum and maximum expected values and measurement precision ( \Delta z ); Continuous predictors (raster map) — q(\mathbf{s}) ; at new unvisited locations Discrete predictors (polygon map); Validation set (point map) — z*(\mathbf{s}_j) j=1,\ldots ,l (optional); Lag spacing and limiting distance (required to fit the variogram); OUTPUTS: Map of predictions and relative prediction error; Best subset of predictors and correlation significance (adjusted R-square); Variogram model parameters (e.g. C_0 , C_1 , R ) GLS drift model coefficients; Accuracy of prediction at validation points: mean prediction error (MPE) and root mean square prediction error (RMSPE);

Text derived from https://en.wikipedia.org/w/index.php?oldid=1370121354 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

3 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.