Lesson plan
Hyperprior
In Bayesian statistics, a hyperprior is a prior distribution on a hyperparameter, that is, on a parameter of a prior distribution. As with the term hyperparameter, the use of hyper is to distinguish it from a prior distribution of a parameter of the model for the underlying system. They arise particularly in the use of hierarchical models. For example, if one is using a beta distribution to model the distribution of the parameter p of a Bernoulli distribution, then: * The Bernoulli distribution (with parameter p) is the model of the underlying system; * p is a parameter of the underlying system (Bernoulli distribution); * The beta distribution (with parameters α and β) is the prior distribution of p; * α and β are parameters of the prior distribution (beta distribution), hence hyperparameters; * A prior distribution of α and β is thus a hyperprior. In principle, one can iterate the above: if the hyperprior itself has hyperparameters, these may be called hyperhyperparameters, and so forth. One can analogously call the posterior distribution on the hyperparameter the hyperposterior, and, if these are in the same family, call them conjugate hyperdistributions or a conjugate hyperprior. However, this rapidly becomes very abstract and removed from the original problem.
Article summary
In Bayesian statistics, a hyperprior is a prior distribution on a hyperparameter, that is, on a parameter of a prior distribution. As with the term hyperparameter, the use of hyper is to distinguish it from a prior distribution of a parameter of the model for the underlying system. They arise particularly in the use of hierarchical models. For example, if one is using a beta distribution to model the distribution of the parameter p of a Bernoulli distribution, then: * The Bernoulli distribution (with parameter p) is the model of the underlying system; * p is a parameter of the underlying system (Bernoulli distribution); * The beta distribution (with parameters α and β) is the prior distribution of p; * α and β are parameters of the prior distribution (beta distribution), hence hyperparameters; * A prior distribution of α and β is thus a hyperprior. In principle, one can iterate the above: if the hyperprior itself has hyperparameters, these may be called hyperhyperparameters, and so forth. One can analogously call the posterior distribution on the hyperparameter the hyperposterior, and, if these are in the same family, call them conjugate hyperdistributions or a conjugate hyperprior. However, this rapidly becomes very abstract and removed from the original problem.
Key claims
No claims recorded.
Discussion questions
- Summarise the article in your own words. Which single claim would you verify first, and why?
- Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
- If two sources disagreed about one of these facts, what would you need in order to trust one over the other?
Bibliography
No sources recorded.
Key claims and bibliography are generated from the same tracked claims and sources as the article page.