Dirichlet negative multinomial distribution

{{Probability distribution | box_width = 350px | type = mass | notation = \textrm{DNM}(x_0,\,\alpha_0 ,\, \boldsymbol{\alpha}) | parameters = x_0 \in \R_{>0}, \alpha_0 \in \R_{>0}, \boldsymbol{\alpha} \in \R_{>0}^{m} | support = x_i \in…

Uses your system voice; voice and rate in settings.

Snapshot

≈ 9 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

{{Probability distribution | box_width = 350px | type = mass | notation = \textrm{DNM}(x_0,\,\alpha_0 ,\, \boldsymbol{\alpha}) | parameters = x_0 \in \R_{>0}, \alpha_0 \in \R_{>0}, \boldsymbol{\alpha} \in \R_{>0}^{m} | support = x_i \in \{0,1,2,\ldots\}, 1\leq i\leq m | pdf = \frac{\mathrm{B}(x_\bullet,\alpha_\bullet)}{\mathrm{B}(x_0,\alpha_0)}\prod_{i=1}^m \frac{\Gamma(x_i+\alpha_i)}{x_i!\Gamma(\alpha_i)} where x_{\bullet}=\Sigma_{i=0}^{m}x_i , \alpha_{\bullet}=\Sigma_{i=0}^{m}\alpha_i and Γ(x) is the Gamma function and B is the beta function. | cdf = | mean = \tfrac{x_0}{\alpha_0-1}\boldsymbol{\alpha} for \alpha_0>1 | variance = \,\frac{x_0(x_0+\alpha_0-1)}{(\alpha_0-1)^2(\alpha_0-2)}\left[\boldsymbol{\alpha} \boldsymbol{\alpha}^{\operatorname{T}} + (\alpha_0-1)\operatorname{diag}(\boldsymbol{\alpha}) \right] for \alpha_0>2 | mode = | entropy = | mgf = does not exist | cf = \frac{\mathrm{B}(x_0, \alpha_{\bullet})}{\mathrm{B}(x_0,\alpha_0)} F_D^{(m)}(x_0,\boldsymbol{\alpha};x_0+\alpha_{\bullet}; e^{it_1}, \cdots,e^{it_m} ) where F_D^{(m)} is the Lauricella function }} In probability theory and statistics, the Dirichlet negative multinomial distribution is a multivariate distribution on the non-negative integers. It is a multivariate extension of the beta negative binomial distribution.…

{{Probability distribution | box_width = 350px | type = mass | notation = \textrm{DNM}(x_0,\,\alpha_0 ,\, \boldsymbol{\alpha}) | parameters = x_0 \in \R_{>0}, \alpha_0 \in \R_{>0}, \boldsymbol{\alpha} \in \R_{>0}^{m} | support = x_i \in \{0,1,2,\ldots\}, 1\leq i\leq m | pdf = \frac{\mathrm{B}(x_\bullet,\alpha_\bullet)}{\mathrm{B}(x_0,\alpha_0)}\prod_{i=1}^m \frac{\Gamma(x_i+\alpha_i)}{x_i!\Gamma(\alpha_i)} where x_{\bullet}=\Sigma_{i=0}^{m}x_i , \alpha_{\bullet}=\Sigma_{i=0}^{m}\alpha_i and Γ(x) is the Gamma function and B is the beta function. | cdf = | mean = \tfrac{x_0}{\alpha_0-1}\boldsymbol{\alpha} for \alpha_0>1 | variance = \,\frac{x_0(x_0+\alpha_0-1)}{(\alpha_0-1)^2(\alpha_0-2)}\left[\boldsymbol{\alpha} \boldsymbol{\alpha}^{\operatorname{T}} + (\alpha_0-1)\operatorname{diag}(\boldsymbol{\alpha}) \right] for \alpha_0>2 | mode = | entropy = | mgf = does not exist | cf = \frac{\mathrm{B}(x_0, \alpha_{\bullet})}{\mathrm{B}(x_0,\alpha_0)} F_D^{(m)}(x_0,\boldsymbol{\alpha};x_0+\alpha_{\bullet}; e^{it_1}, \cdots,e^{it_m} ) where F_D^{(m)} is the Lauricella function }} In probability theory and statistics, the Dirichlet negative multinomial distribution is a multivariate distribution on the non-negative integers. It is a multivariate extension of the beta negative binomial distribution.

It is also a generalization of the negative multinomial distribution (NM(k, p)) allowing for heterogeneity or overdispersion to the probability vector. It is used in quantitative marketing research to flexibly model the number of household transactions across multiple brands.

If parameters of the Dirichlet distribution are \boldsymbol{\alpha} , and if X \mid p \sim \operatorname{NM}(x_0,\mathbf{p}), where \mathbf{p} \sim \operatorname{Dir}(\alpha_0,\boldsymbol\alpha), then the marginal distribution of X is a Dirichlet negative multinomial distribution: X \sim \operatorname{DNM}(x_0,\alpha_0,\boldsymbol{\alpha}). In the above, \operatorname{NM}(x_0, \mathbf{p}) is the negative multinomial distribution and \operatorname{Dir}(\alpha_0,\boldsymbol\alpha) is the Dirichlet distribution.

Dirichlet negative multinomial as a compound distribution

The Dirichlet distribution is a conjugate distribution to the negative multinomial distribution. This fact leads to an analytically tractable compound distribution.

For a random vector of category counts \mathbf{x}=(x_1,\dots,x_m) , distributed according to a negative multinomial distribution, the compound distribution is obtained by integrating on the distribution for p which can be thought of as a random vector following a Dirichlet distribution: \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})=\int_{\mathbf{p}}\mathrm{NegMult}(\mathbf{x}\mid x_0, \mathbf{p}) \mathrm{Dir}(\mathbf{p}\mid\alpha_0,\boldsymbol{\alpha})\textrm{d}\mathbf{p} \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})={\frac{\Gamma\left(\sum_{i=0}^m{x_i}\right)}{\Gamma(x_0)\prod_{i=1}^m x_i!}} \frac{1}{\mathrm{B}(\boldsymbol\alpha_+)}\int_{\mathbf{p}} \prod_{i=0}^m p_i^{x_i+\alpha_i - 1}\textrm{d}\mathbf{p} which results in the following formula: \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})={\frac{\Gamma\left(\sum_{i=0}^m{x_i}\right)}{\Gamma(x_0)\prod_{i=1}^m x_i!}} \frac{{\mathrm{B}}(\mathbf{x_+}+\boldsymbol\alpha_+)}{\mathrm{B}(\boldsymbol\alpha_+)} where \mathbf{x_+} and \boldsymbol\alpha_+ are the m+1 dimensional vectors created by appending the scalars x_0 and \alpha_0 to the m dimensional vectors \mathbf{x} and \boldsymbol\alpha respectively and \mathrm{B} is the multivariate version of the beta function. We can write this equation explicitly as \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})=x_0\frac{\Gamma(\sum_{i=0}^m x_i)\Gamma(\sum_{i=0}^m \alpha_i)}{\Gamma(\sum_{i=0}^m (x_i+\alpha_i))} \prod_{i=0}^m \frac{\Gamma(x_i+\alpha_i)}{\Gamma(x_i+1)\Gamma(\alpha_i)}.

Alternative formulations exist. One convenient representation is \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})= \frac{\Gamma(x_\bullet)}{\Gamma(x_0)\prod_{i=1}^m \Gamma(x_i+1)} \times \frac{\Gamma(\alpha_\bullet)}{\prod_{i=0}^m \Gamma(\alpha_i)} \times \frac{\prod_{i=0}^m \Gamma(x_i+\alpha_i)}{\Gamma(x_\bullet+\alpha_\bullet)} where x_\bullet= x_0+x_1+ \cdots + x_m and \alpha_{\bullet}= \alpha_0+\alpha_1+ \cdots + \alpha_m . This can also be written \Pr(\mathbf{x}\mid x_0, \alpha_0, \boldsymbol{\alpha})=\frac{\mathrm{B}(x_\bullet,\alpha_\bullet)}{\mathrm{B}(x_0,\alpha_0)}\prod_{i=1}^m \frac{\Gamma(x_i+\alpha_i)}{x_i! \Gamma(\alpha_i)}.

Marginal distributions

To obtain the marginal distribution over a subset of Dirichlet negative multinomial random variables, one only needs to drop the irrelevant \alpha_i 's (the variables that one wants to marginalize out) from the \boldsymbol{\alpha} vector. The joint distribution of the remaining random variates is \mathrm{DNM}(x_0,\alpha_0,\boldsymbol{\alpha_{(-)}}) where \boldsymbol{\alpha_{(-)}} is the vector with the removed \alpha_i 's. The univariate marginals are said to be beta negative binomially distributed.

Conditional distributions

If m-dimensional x is partitioned as follows \mathbf{x} = \begin{bmatrix} \mathbf{x}^{(1)} \\ \mathbf{x}^{(2)} \end{bmatrix} \text{ with sizes }\begin{bmatrix} q \times 1 \\ (m-q) \times 1 \end{bmatrix} and accordingly \boldsymbol{\alpha} \boldsymbol\alpha = \begin{bmatrix} \boldsymbol\alpha^{(1)} \\ \boldsymbol\alpha^{(2)} \end{bmatrix} \text{ with sizes }\begin{bmatrix} q \times 1 \\ (m-q) \times 1 \end{bmatrix} then the conditional distribution of \mathbf{X}^{(1)} on \mathbf{X}^{(2)}=\mathbf{x}^{(2)} is \mathrm{DNM}(x_0^{\prime},\alpha_0^{\prime},\boldsymbol\alpha^{(1)}) where x_0^{\prime} = x_0 + \sum_{i=1}^{m-q} x_i^{(2)} and \alpha_0^{\prime} = \alpha_0 + \sum_{i=1}^{m-q} \alpha_i^{(2)} . That is, \Pr(\mathbf{x}^{(1)}\mid \mathbf{x}^{(2)}, x_0, \alpha_0, \boldsymbol{\alpha})= \frac{\mathrm{B}(x_\bullet,\alpha_\bullet)}{\mathrm{B}(x_0^{\prime} ,\alpha_0^{\prime}) }\prod_{i=1}^q\frac{\Gamma(x_i^{(1)}+\alpha_i^{(1)})}{(x_i^{(1)}!)\Gamma(\alpha_i^{(1)})}

Conditional on the sum

The conditional distribution of a Dirichlet negative multinomial distribution on \sum_{i=1}^m x_i = n is Dirichlet-multinomial distribution with parameters n and \boldsymbol{\alpha} . That is \Pr(\mathbf{x} \mid \sum_{i=1}^m x_i =n, x_0, \alpha_0, \boldsymbol{\alpha})= \frac{n!\Gamma\left(\sum_{i=1}^m \alpha_i\right)} {\Gamma\left(n+\sum_{i=1}^m \alpha_i\right)}\prod_{i=1}^m\frac{\Gamma(x_{i}+\alpha_{i})}{x_{i}!\Gamma(\alpha_{i})} .

Notice that the expression does not depend on x_0 or \alpha_0 .

Aggregation

If X = (X_1, \ldots, X_m)\sim\operatorname{DNM}(x_0, \alpha_0, \alpha_1,\ldots,\alpha_m) then, if the random variables with positive subscripts i and j are dropped from the vector and replaced by their sum, X' = (X_1, \ldots, X_i + X_j, \ldots, X_m)\sim\operatorname{DNM} \left(x_0, \alpha_0, \alpha_1,\ldots,\alpha_i+\alpha_j,\ldots,\alpha_m \right).

Correlation matrix

For \alpha_0>2 the entries of the correlation matrix are \rho(X_i,X_i) = 1. \rho(X_i,X_j) = \frac{\operatorname{cov}(X_i,X_j)}{\sqrt{\operatorname{var}(X_i)\operatorname{var}(X_j)}} = \sqrt{\frac{\alpha_i \alpha_j}{(\alpha_0+\alpha_i-1)(\alpha_0+\alpha_j-1)}}.

Heavy tailed

The Dirichlet negative multinomial is a heavy tailed distribution. It does not have a finite mean for \alpha_0 \leq 1 and it has infinite covariance matrix for \alpha_0 \leq 2 . Therefore the moment generating function does not exist.

Dirichlet negative multinomial as a Pólya urn model

In the case when the m+2 parameters x_0, \alpha_0 and \boldsymbol{\alpha} are positive integers the Dirichlet negative multinomial can also be motivated by an urn model - or more specifically a basic Pólya urn model. Consider an urn initially containing \sum_{i=0}^m{\alpha_i} balls of m+1 various colors including \alpha_0 red balls (the stopping color).

The vector \boldsymbol{\alpha} gives the respective counts of the other balls of various m non-red colors. At each step of the model, a ball is drawn at random from the urn and replaced, along with one additional ball of the same color. The process is repeated over and over, until x_0 red colored balls are drawn.

The random vector \mathbf{X} of observed draws of the other m non-red colors are distributed according to a \mathrm{DNM}(x_0, \alpha_0, \boldsymbol{\alpha}) . Note, at the end of the experiment, the urn always contains the fixed number x_0+\alpha_0 of red balls while containing the random number \mathbf{X}+\boldsymbol{\alpha} of the other m colors.

See also

Beta negative binomial distribution Negative multinomial distribution Dirichlet-multinomial distribution

Text derived from https://en.wikipedia.org/w/index.php?oldid=1325535793 under CC BY-SA 4.0; modifications have been made.

Provenance

snapshot enwiki-001325535793 · captured 2025-12-03 · not yet sealed in the ledger · verify the chain · version history

Cite this page as: encyclopegia.org, “Dirichlet negative multinomial distribution”, snapshot enwiki-001325535793. https://encyclopegia.org/a/dirichlet-negative-multinomial-distribution

Sources cited in this revision

No external citation was extracted for this revision. That is a statement about the source, not a claim that none exists.