Lesson plan
Formation matrix
In statistics and information theory, the expected formation matrix and the observed formation matrix are concepts used to quantify the uncertainty associated with parameter estimates derived from a likelihood function L(\theta) . They are the matrix inverses of the Fisher information matrix and the observed information matrix, respectively. Because Fisher information measures the amount of information that an observable random variable carries about an unknown parameter \theta , its inverse represents a measure of the dispersion or variance for an estimator of \theta . The formation matrix is therefore related to the covariance matrix of an estimator and is central to the Cramér–Rao bound, which establishes a lower bound on the variance of unbiased estimators. These matrices appear naturally in the asymptotic expansion of the distribution of many statistics related to the likelihood ratio. Currently, no single notation for formation matrices is universally used. In works by Ole E. Barndorff-Nielsen and Peter McCullagh, the symbol j^{ij} denotes the element in the i-th row and j-th column of the observed formation matrix. An alternative notation, g^{ij} , arises from the geometric interpretation of the Fisher information matrix as a metric tensor, denoted g_{ij} . Following Einstein notation, these are related by g_{ik}g^{kj} = \delta_i^j .
Article summary
In statistics and information theory, the expected formation matrix and the observed formation matrix are concepts used to quantify the uncertainty associated with parameter estimates derived from a likelihood function L(\theta) . They are the matrix inverses of the Fisher information matrix and the observed information matrix, respectively. Because Fisher information measures the amount of information that an observable random variable carries about an unknown parameter \theta , its inverse represents a measure of the dispersion or variance for an estimator of \theta . The formation matrix is therefore related to the covariance matrix of an estimator and is central to the Cramér–Rao bound, which establishes a lower bound on the variance of unbiased estimators. These matrices appear naturally in the asymptotic expansion of the distribution of many statistics related to the likelihood ratio. Currently, no single notation for formation matrices is universally used. In works by Ole E. Barndorff-Nielsen and Peter McCullagh, the symbol j^{ij} denotes the element in the i-th row and j-th column of the observed formation matrix. An alternative notation, g^{ij} , arises from the geometric interpretation of the Fisher information matrix as a metric tensor, denoted g_{ij} . Following Einstein notation, these are related by g_{ik}g^{kj} = \delta_i^j .
Key claims
No claims recorded.
Discussion questions
- Summarise the article in your own words. Which single claim would you verify first, and why?
- Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
- If two sources disagreed about one of these facts, what would you need in order to trust one over the other?
Bibliography
No sources recorded.
Key claims and bibliography are generated from the same tracked claims and sources as the article page.