additive model
statistical regression model
≈ 2 min read
additive model. encyclopegia.org, snapshot additive-model-535151-cf4bf9c75f6e15b0. /a/additive-model
Names in other languages
- DeutschAdditives Modell
- ItalianoModello additivoAM
- Українськаадитивна модель
- Englishadditive modelAM
- FrançaisModèle additif
- 日本語加法モデル
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In statistics, an additive model (AM) is a nonparametric regression method. It was suggested by Jerome H. Friedman and Werner Stuetzle (1981)[1] and is an essential part of the ACE algorithm. The AM uses a one-dimensional smoother to build a restricted class of nonparametric regression models. Because of this, it is less affected by the curse of dimensionality than a p-dimensional smoother. Furthermore, the AM is more flexible than a standard linear model, while being more interpretable than a general regression surface at the cost of approximation errors. Problems with AM, like many other machine-learning methods, include model selection, overfitting, and multicollinearity.
Description
edit edit sourceGiven a data set {yi,xi1,…,xip}i=1n of n statistical units, where {xi1,…,xip}i=1n represent predictors and yi is the outcome, the additive model takes the form
- E[yi|xi1,…,xip]=β0+∑j=1pfj(xij)
or
- Y=β0+∑j=1pfj(Xj)+ε
Where E[ϵ]=0, Var(ϵ)=σ2 and E[fj(Xj)]=0. The functions fj(xij) are unknown smooth functions fit from the data. Fitting the AM (i.e. the functions fj(xij)) can be done using the backfitting algorithm proposed by Andreas Buja, Trevor Hastie and Robert Tibshirani (1989).[2]
See also
edit edit source- Generalized additive model
- Backfitting algorithm
- Projection pursuit regression
- Generalized additive model for location, scale, and shape (GAMLSS)
- Median polish
- Projection pursuit
References
edit edit source- ^ Friedman, J.H. and Stuetzle, W. (1981). "Projection Pursuit Regression", Journal of the American Statistical Association 76:817–823. doi:10.1080/01621459.1981.10477729 Wikipedia revision 1266336386, retrieved 2026-11-18
- ^ Buja, A., Hastie, T., and Tibshirani, R. (1989). "Linear Smoothers and Additive Models", The Annals of Statistics 17(2):453–555. JSTOR 2241560 Wikipedia revision 1266336386, retrieved 2026-11-18
Further reading
edit edit source- Breiman, L. and Friedman, J.H. (1985). "Estimating Optimal Transformations for Multiple Regression and Correlation", Journal of the American Statistical Association 80:580–598. doi:10.1080/01621459.1985.10478157
Text derived from https://en.wikipedia.org/w/index.php?oldid=1266336386 under CC BY-SA 4.0; modifications have been made.