Lesson plan

Error exponents in hypothesis testing

In statistical hypothesis testing, the error exponent of a hypothesis testing procedure is the rate at which the probabilities of Type I and Type II decay exponentially with the size of the sample used in the test. For example, if the probability of error P_{\mathrm{error}} of a test decays as e^{-n \beta} , where n is the sample size, the error exponent is \beta . Formally, the error exponent of a test is defined as the limiting value of the ratio of the negative logarithm of the error probability to the sample size for large sample sizes: \lim_{n \to \infty}\frac{-\log P_\text{error}}{n} . Error exponents for different hypothesis tests are computed using Sanov's theorem and other results from large deviations theory. There are various methods used to show that an error exponent is achievable, including the likelihood ratio (which is known to be optimal in certain circumstances), and the empirical distribution. Error exponents are sometimes referred to as error rates, due to the connection between hypothesis testing and information theory.

Back to article

Article summary

In statistical hypothesis testing, the error exponent of a hypothesis testing procedure is the rate at which the probabilities of Type I and Type II decay exponentially with the size of the sample used in the test. For example, if the probability of error P_{\mathrm{error}} of a test decays as e^{-n \beta} , where n is the sample size, the error exponent is \beta . Formally, the error exponent of a test is defined as the limiting value of the ratio of the negative logarithm of the error probability to the sample size for large sample sizes: \lim_{n \to \infty}\frac{-\log P_\text{error}}{n} . Error exponents for different hypothesis tests are computed using Sanov's theorem and other results from large deviations theory. There are various methods used to show that an error exponent is achievable, including the likelihood ratio (which is known to be optimal in certain circumstances), and the empirical distribution. Error exponents are sometimes referred to as error rates, due to the connection between hypothesis testing and information theory.

Key claims

No claims recorded.

Discussion questions

  1. Summarise the article in your own words. Which single claim would you verify first, and why?
  2. Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
  3. If two sources disagreed about one of these facts, what would you need in order to trust one over the other?

Bibliography

No sources recorded.

Key claims and bibliography are generated from the same tracked claims and sources as the article page.