CLs method (particle physics)

In particle physics, CLs represents a statistical method for setting upper limits (also called exclusion limits ) on model parameters, a particular form of interval estimation used for parameters that can take only non-negative values.

Uses your system voice; voice and rate in settings.

Snapshot

≈ 7 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

In particle physics, CLs represents a statistical method for setting upper limits (also called exclusion limits ) on model parameters, a particular form of interval estimation used for parameters that can take only non-negative values. Although CLs are said to refer to Confidence Levels, "The method's name is ... misleading, as the CLs exclusion region is not a confidence interval."

It was first introduced by physicists working at the LEP experiment at CERN and has since been used by many high energy physics experiments. It is a frequentist method in the sense that the properties of the limit are defined by means of error probabilities, however it differs from standard confidence intervals in that the stated confidence level of the interval is not equal to its coverage probability.

The reason for this deviation is that standard upper limits based on a most powerful test necessarily produce empty intervals with some fixed probability when the parameter value is zero, and this property is considered undesirable by most physicists and statisticians. Upper limits derived with the CLs method always contain the zero value of the parameter and hence the coverage probability at this point is always 100%.

The definition of CLs does not follow from any precise theoretical framework of statistical inference and is therefore described sometimes as ad hoc.…

In particle physics, CLs represents a statistical method for setting upper limits (also called exclusion limits ) on model parameters, a particular form of interval estimation used for parameters that can take only non-negative values. Although CLs are said to refer to Confidence Levels, "The method's name is ... misleading, as the CLs exclusion region is not a confidence interval."

It was first introduced by physicists working at the LEP experiment at CERN and has since been used by many high energy physics experiments. It is a frequentist method in the sense that the properties of the limit are defined by means of error probabilities, however it differs from standard confidence intervals in that the stated confidence level of the interval is not equal to its coverage probability.

The reason for this deviation is that standard upper limits based on a most powerful test necessarily produce empty intervals with some fixed probability when the parameter value is zero, and this property is considered undesirable by most physicists and statisticians. Upper limits derived with the CLs method always contain the zero value of the parameter and hence the coverage probability at this point is always 100%.

The definition of CLs does not follow from any precise theoretical framework of statistical inference and is therefore described sometimes as ad hoc. It has however close resemblance to concepts of statistical evidence proposed by the statistician Allan Birnbaum.

An equivalent definition can be made by considering a hypothesis test of the null hypothesis H_0:\theta=\theta_0 against the alternative H_1:\theta=0 . Then the numerator in ( ), when evaluated at \theta_0 , correspond to the type-I error probability ( \alpha ) of the test (i.e., \theta_0 is rejected when \theta_{up}(X) ) and the denominator to the power ( 1-\beta ).

The criterion for rejecting H_0 thus requires that the ratio \alpha/(1-\beta) will be smaller than \alpha' . This can be interpreted intuitively as saying that \theta_0 is excluded because it is \alpha' less likely to observe such an extreme outcome as X when \theta_0 is true than it is when the alternative \theta=0 is true.

The calculation of the upper limit is usually done by constructing a test statistic q_\theta(X) and finding the value of \theta for which \frac{\mathbb{P}(q_\theta(X) \geq q_\theta^* |\theta)}{\mathbb{P}( q_\theta(X) \geq q_\theta^* |0 )} = \alpha' . where q_\theta^* is the observed outcome of the experiment. The original motivation for CLs was based on a conditional probability calculation suggested by physicist G. Zech for an event counting experiment.

Suppose an experiment consists of measuring n events coming from signal and background processes, both described by Poisson distributions with respective rates s and b , namely n \sim \text{Poiss}(s+b) . b is assumed to be known and s is the parameter to be estimated by the experiment. The standard procedure for setting an upper limit on s given an experimental outcome n^* consists of excluding values of s for which \mathbb{P}(n \leq n^*|s+b) \leq \alpha , which guarantees at least 1-\alpha coverage.

Consider, for example, a case where b=3 and n^*=0 events are observed, then one finds that s+b \geq 3 is excluded at 95% confidence level. But this implies that s \geq 0 is excluded, namely all possible values of s . Such a result is difficult to interpret because the experiment cannot essentially distinguish very small values of s from the background-only hypothesis, and thus declaring that such small values are excluded (in favor of the background-only hypothesis) seems inappropriate.

To overcome this difficulty Zech suggested conditioning the probability that n \leq n^* on the observation that n_b \leq n^* , where n_b is the (unmeasurable) number of background events. The reasoning behind this is that when n_b is small the procedure is more likely to produce an error (i.e., an interval that does not cover the true value) than when n_b is large, and the distribution of n_b itself is independent of s . That is, not the over-all error probability should be reported but the conditional probability given the knowledge one has on the number of background events in the sample.

This conditional probability is \mathbb{P}(n \leq n^* |n_b \leq n^* , s+b) = \frac{\mathbb{P}(n \leq n^*, n_b \leq n^* |s+b)}{\mathbb{P}(n_b \leq n^* |s+b)} = \frac{\mathbb{P}(n \leq n^* |s+b)}{\mathbb{P}(n \leq n^* |b)}. which correspond to the above definition of CLs. The first equality just uses the definition of Conditional probability, and the second equality comes from the fact that if n \leq n^* \Rightarrow n_b \leq n^* and the number of background events is by definition independent of the signal strength. p_{\theta} = \mathbb{P}( q(X) > q^* |\theta) where q* is the outcome observed by the experiment.

Then p_{\theta} can be regarded as an unmeasurable (since \theta is unknown) random variable, whose distribution is uniform between 0 and 1 independent of \theta . If the test is unbiased then the outcome q* implies p_{\theta} \leq \mathbb{P}( q(X) > q^* |0 ) \equiv p_0^* from which, similarly to conditioning on n_b in the previous case, one obtains \mathbb{P}(q(X) \geq q^* |p_\theta \leq p_0^* , \theta) = \frac{\mathbb{P}(q(X) \geq q^* |\theta)}{\mathbb{P}(p_\theta \leq p_0^* |\theta)} \theta_{up} = \hat\theta + \sigma\Phi^{-1}(1 - \alpha'\Phi(\hat\theta / \sigma ) ) , where \Phi is the standard normal cumulative distribution, \hat\theta is the maximum likelihood estimator of \theta and \sigma is its standard deviation; the latter might be estimated from the inverse of the Fisher information matrix or by using the "Asimov" data set.

This result happens to be equivalent to a Bayesian credible interval if a uniform prior for \theta is used.

Text derived from https://en.wikipedia.org/w/index.php?oldid=1359077683 under CC BY-SA 4.0; modifications have been made.

Provenance

snapshot enwiki-001359077683 · captured 2026-06-12 · not yet sealed in the ledger · verify the chain · version history

Cite this page as: encyclopegia.org, “CLs method (particle physics)”, snapshot enwiki-001359077683. https://encyclopegia.org/a/cls-method-particle-physics

Sources cited in this revision

4 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.