Neyman Type A distribution

Neyman Type A

Probability mass function The horizontal axis is the index x, the number of occurrences. The vertical axis we have the probability that the v.a. take the value of x
Cumulative distribution function The horizontal axis is the index x, the number of occurrences. The vertical axis we have the acumulative sum of probabilityes from ${\displaystyle P(Y=0)}$ to ${\displaystyle P(Y=x)}$
Notation	${\displaystyle \operatorname {NA} (\lambda ,\phi )}$
Parameters	${\displaystyle \lambda >0,\phi >0}$
Support	x ∈ { 0, 1, 2, ... }
PMF	${\displaystyle {\frac {e^{-\lambda }\phi ^{x}}{x!}}\sum _{j=0}^{\infty }{\frac {(\lambda e^{-\phi })^{j}j^{x}}{j!}}}$
CDF	${\displaystyle e^{-\lambda }\sum _{i=0}^{x}\sum _{j=0}^{\infty }{\frac {\phi ^{i}(\lambda e^{-\phi })^{j}j^{i}}{i!j!}}}$
Mean	${\displaystyle \lambda \phi }$
Variance	${\displaystyle \lambda \phi (1+\phi )}$
Skewness	${\displaystyle {\frac {\lambda \phi (1+3\phi +\phi ^{2})}{(\lambda \phi (1+\phi ))^{3/2}}}}$
Ex. kurtosis	${\displaystyle {\frac {1+7\phi +6\phi ^{2}+\phi ^{3}}{\phi \lambda (1+\phi )^{2}}}}$
MGF	${\displaystyle \exp(\lambda (e^{\phi (e^{t}-1)}-1))}$
CF	${\displaystyle \exp(\lambda (e^{\phi (e^{it}-1)}-1))}$
PGF	${\displaystyle \exp(\lambda (e^{\phi (s-1)}-1))}$

In statistics and probability, the Neyman Type A distribution is a discrete probability distribution from the family of Compound Poisson distribution. First of all, to easily understand this distribution we will demonstrate it with the following example explained in Univariate Discret Distributions; ^[1] we have a statistical model of the distribution of larvae in a unit area of field (in a unit of habitat) by assuming that the variation in the number of clusters of eggs per unit area (per unit of habitat) could be represented by a Poisson distribution with parameter ${\displaystyle \lambda }$, while the number of larvae developing per cluster of eggs are assumed to have independent Poisson distribution all with the same parameter ${\displaystyle \phi }$. If we want to know how many larvae there are, we define a random variable Y as the sum of the number of larvae hatched in each group (given j groups). Therefore, Y = X₁ + X₂ + ... X_j, where X₁,...,X_j are independent Poisson variables with parameter ${\displaystyle \lambda }$ and ${\displaystyle \phi }$.

History

Jerzy Neyman was born in Russia in April 16 of 1894, he was a Polish statistician who spent the first part of his career in Europe. In 1939 he developed the Neyman Type A distribution ^[1] to describe the distribution of larvae in experimental field plots. Above all, it is used to describe populations based on contagion, e.g., entomology (Beall[1940], ^[2] Evans[1953] ^[3] ), accidents (Creswell i Froggatt [1963]), ^[4] and bacteriology.

The original derivation of this distribution was on the basis of a biological model and, presumably, it was expected that a good fit to the data would justify the hypothesized model. However, it is now known that it is possible to derive this distribution from different models (William Feller[1943]), ^[5] and in view of this, Neyman's distribution derive as Compound Poisson distribution. This interpretation makes them suitable for modelling heterogeneous populations and renders them examples of apparent contagion.

Despite this, the difficulties in dealing with Neyman's Type A arise from the fact that its expressions for probabilities are highly complex. Even estimations of parameters through efficient methods, such as maximum likelihood, are tedious and not easy to understand equations.

Definition

Probability generating function

The probability generating function (pgf) G₁(z), which creates N independent X_j random variables, is used to a branching process. Each X_j produces a random number of individuals, where X₁, X₂,... have the same distribution as X, which is that of X with pgf G₂(z). The total number of  individuals is then the random variable, ^[1]

${\displaystyle Y=SN=X_{1}+X_{2}+...+X_{N}}$

The p.g.f. of the distribution of SN is :

${\displaystyle E[z^{SN}]=E_{N}[E[z^{SN}|N]]=E_{N}[G_{2}(z)]=G_{1}(G_{2}(z))}$

One of the notations, which is particularly helpful, allows us to use a symbolic representation to refer to  an F1 distribution that has been generalized by an F2 distribution is,

${\displaystyle Y\sim F_{1}\bigwedge F_{N}}$

In this instance, it is written as,

${\displaystyle Y\sim \operatorname {Pois(\lambda )} \bigwedge \operatorname {Pois(\phi )} }$

Finally, the probability generating function is,

${\displaystyle G_{Y}(z)=\exp(\lambda (e^{\phi (z-1)}-1))}$

From the generating function of probabilities we can calculate the probability mass function explained below.

Probability mass function

Let X₁,X₂,...X_j be Poisson independent variables. The probability distribution of the random variable Y = X₁ +X₂+...X_j is the Neyman's Type A distribution with parameters ${\displaystyle \lambda }$ and ${\displaystyle \phi }$.

${\displaystyle p_{x}=P(Y=x)={\frac {e^{-\lambda }\phi ^{x}}{x!}}\sum _{j=0}^{\infty }{\frac {(\lambda e^{-\phi })^{j}j^{x}}{j!}}~~}$${\displaystyle ~~x=1,2,...}$

Alternatively,

${\displaystyle p_{x}=P(Y=x)={\frac {e^{-\lambda +\lambda e^{-\phi }}\phi ^{x}}{x!}}\sum _{j=0}^{x}S(x,j)\lambda ^{j}e^{-\phi ^{j}}}$

In order to see how the previous expression develops, we must bear in mind that the probability mass function is calculated from the probability generating function, and use the property of Stirling Numbers. Let's see the development

${\displaystyle G(z)=e^{-\lambda +\lambda e^{-\phi }}\sum _{j=0}^{\infty }{\frac {\lambda ^{j}e^{-j\phi }(e^{\phi z}-1)^{j}}{j|}}}$

${\displaystyle =e^{-\lambda +\lambda e^{-\phi }}\sum _{j=0}^{\infty }(\lambda e^{-\phi })^{j}\sum _{x=j}^{\infty }{\frac {S(x,j)\phi ^{x}z^{x}}{x!}}}$

${\displaystyle ={\frac {e^{-\lambda +\lambda e^{-\phi }}\phi ^{x}}{x!}}\sum _{j=0}^{x}S(x,j)\lambda ^{j}e^{-\phi ^{j}}}$

Another form to estimate the probabilities is with recurring successions, ^[6]

${\displaystyle p_{x}=P(Y=x)={\frac {\lambda \phi e^{-\phi }}{x}}\sum _{r=0}^{x-1}{\frac {\phi ^{r}}{r!}}p_{x-r-1}~~}$,${\displaystyle ~~p_{0}=\exp(-\lambda +\lambda e^{-\phi })}$

Although its length varies directly with n, this recurrence relation is only employed for numerical computation and is particularly useful for computer applications.

where

• x = 0, 1, 2, ... , except for probabilities of recurring successions, where x = 1, 2, 3, ...
• ${\displaystyle j\leq x}$
• ${\displaystyle \lambda }$, ${\displaystyle \phi >0}$.
• x! and j! are the factorials of x and j, respectively.
• one of the properties of Stirling numbers of the second kind is as follows: ^[7]

${\displaystyle (e^{\phi z}-1)^{j}=j!\sum _{x=j}^{\infty }{\frac {S(x,j){\phi z}^{x}}{x!}}}$

Notation

${\displaystyle Y\ \sim \operatorname {NA} (\lambda ,\phi )\,}$

Properties

Moment and cumulant generating functions

The moment generating function of a random variable X is defined as the expected value of e^t, as a function of the real parameter t. For an ${\displaystyle \operatorname {NA(\lambda ,\phi )} }$, the moment generating function exists and is equal to

${\displaystyle M(t)=G_{Y}(e^{t})=\exp(\lambda (e^{\phi (e^{t}-1)}-1))}$

The cumulant generating function is the logarithm of the moment generating function and is equal to ^[1]

${\displaystyle K(t)=\log(M(t))=\lambda (e^{\phi (e^{t}-1)}-1)}$

In the following table we can see the moments of the order from 1 to 4

Order	Moment	Cumulant
1	${\displaystyle \mu _{1}=\lambda \phi }$	${\displaystyle \mu }$
2	${\displaystyle \mu _{2}=\lambda \phi (1+\phi )}$	${\displaystyle \sigma ^{2}}$
3	${\displaystyle \mu _{3}=\lambda \phi (1+3\phi +\phi ^{2})}$	${\displaystyle k_{3}}$
4	${\displaystyle \mu _{4}=\lambda \phi (1+7\phi +6\phi ^{2}+\phi ^{3})+3\lambda ^{2}\phi ^{2}(1+\phi )^{2}}$	${\displaystyle k_{4}+3\sigma ^{4}}$

Skewness

The skewness is the third moment centered around the mean divided by the 3/2 power of the standard deviation, and for the ${\displaystyle \operatorname {NA} }$ distribution is,

${\displaystyle \gamma _{1}={\frac {\mu _{3}}{\mu _{2}^{3/2}}}={\frac {\lambda \phi (1+3\phi +\phi ^{2})}{(\lambda \phi (1+\phi ))^{3/2}}}}$

Kurtosis

The kurtosis is the fourth moment centered around the mean, divided by the square of the variance, and for the ${\displaystyle \operatorname {NA} }$ distribution is,

${\displaystyle \beta _{2}={\frac {\mu _{4}}{\mu _{2}^{2}}}={\frac {\lambda \phi (1+7\phi +6\phi ^{2}+\phi ^{3})+3\lambda ^{2}\phi ^{2}(1+\phi )^{2}}{\lambda ^{2}\phi ^{2}(1+\phi )^{2}}}={\frac {1+7\phi +6\phi ^{2}+\phi ^{3}}{\phi \lambda (1+\phi )^{2}}}+3}$

The excess kurtosis is just a correction to make the kurtosis of the normal distribution equal to zero, and it is the following,

${\displaystyle \gamma _{2}={\frac {\mu _{4}}{\mu _{2}^{2}}}-3={\frac {1+7\phi +6\phi ^{2}+\phi ^{3}}{\phi \lambda (1+\phi )^{2}}}}$

• Always ${\displaystyle \beta _{2}>3}$, or ${\displaystyle \gamma _{2}>0}$ the distribution has a high acute peak around the mean and fatter tails.

Characteristic function

In a discrete distribution the characteristic function of any real-valued random variable is defined as the expected value of ${\displaystyle e^{itX}}$, where i is the imaginary unit and t ∈ R

${\displaystyle \phi (t)=E[e^{itX}]=\sum _{j=0}^{\infty }e^{ijt}P[X=j]}$

This function is related to the moment generating function via ${\displaystyle \phi _{x}(t)=M_{X}(it)}$. Hence for this distribution the characteristic function is,

${\displaystyle \phi _{x}(t)=\exp(\lambda (e^{\phi (e^{it}-1)}-1))}$

• Note that the symbol ${\displaystyle \phi _{x}}$ is used to represent the characteristic function.

Cumulative distribution function

The cumulative distribution function is,

${\displaystyle {\begin{aligned}F(x;\lambda ,\phi )&=P(Y\leq x)\\&=e^{-\lambda }\sum _{i=0}^{x}{\frac {\phi ^{i}}{i!}}\sum _{j=0}^{\infty }{\frac {(\lambda e^{-\phi })^{j}j^{i}}{j!}}\\&=e^{-\lambda }\sum _{i=0}^{x}\sum _{j=0}^{\infty }{\frac {\phi ^{i}(\lambda e^{-\phi })^{j}j^{i}}{i!j!}}\end{aligned}}}$

Other properties

• The index of dispersion is a normalized measure of the dispersion of a probability distribution. It is defined as the ratio of the variance ${\displaystyle \sigma ^{2}}$ to the mean ${\displaystyle \mu }$, ^[8]

${\displaystyle d={\frac {\sigma ^{2}}{\mu }}=1+\phi }$

• From a sample of size N, where each random variable Y_i comes from a ${\displaystyle \operatorname {NA(\lambda ,\phi )} }$, where Y₁, Y₂, .., Y_n are independent. This gives the MLE estimator as, ^[9]

${\displaystyle \sum _{i=1}^{N}{\frac {x_{i}}{N}}={\bar {x}}={\bar {\lambda }}{\bar {\phi }}~~~}$ where ${\displaystyle \mu }$ is the poblational mean of ${\displaystyle {\bar {x}}}$

• Between the two earlier expressions We are able to parametrize using ${\displaystyle \mu }$ and ${\displaystyle d}$,

${\displaystyle {\begin{cases}\mu =\lambda \phi \\d=1+\phi \end{cases}}\longrightarrow \quad \!{\begin{aligned}\lambda ={\frac {\mu }{d-1}}\\\phi =d-1\end{aligned}}}$

Parameter estimation

Method of moments

The mean and the variance of the NA(${\displaystyle \lambda ,\phi }$) are ${\displaystyle \mu =\lambda \phi }$ and ${\displaystyle \lambda \phi (1+\phi )}$, respectively. So we have these two equations, ^[10]

${\displaystyle {\begin{cases}{\bar {x}}=\lambda \phi \\s^{2}=\lambda \phi (1+\phi )\end{cases}}}$

• ${\displaystyle s^{2}}$ and ${\displaystyle {\bar {x}}}$ are the mostral variance and mean respectively.

Solving these two equations we get the moment estimators ${\displaystyle {\hat {\lambda }}}$ and ${\displaystyle {\hat {\phi }}}$ of ${\displaystyle \lambda }$ and ${\displaystyle \phi }$.

${\displaystyle {\bar {\lambda }}={\frac {{\bar {x}}^{2}}{s^{2}-{\bar {x}}}}}$

${\displaystyle {\bar {\phi }}={\frac {s^{2}-{\bar {x}}}{\bar {x}}}}$

Maximum likelihood

Calculating the maximum likelihood estimator of ${\displaystyle \lambda }$ and ${\displaystyle \phi }$ involves multiplying all the probabilities in the probability mass function to obtain the expression ${\displaystyle {\mathcal {L}}(\lambda ,\phi ;x_{1},\ldots ,x_{n})}$.

When we apply the parameterization adjustment defined in "Other Properties," we get ${\displaystyle {\mathcal {L}}(\mu ,d;X)}$. We may define the Maximum likelihood estimation based on a single parameter if we estimate the ${\displaystyle \mu }$ as the ${\displaystyle {\bar {x}}}$ (sample mean) given a sample X of size N. We can see it below.

${\displaystyle {\mathcal {L}}(d;X)=\prod _{i=1}^{n}P(x_{i};d)}$

• To estimate the probabilities, we will use the p.m.f. of recurring successions, so that the calculation is less complex.

Testing Poisson assumption

When ${\displaystyle \operatorname {NA(\lambda ,\phi )} }$ is used to simulate a data sample it is important to see if the Poisson distribution fits the data well. For this, the following Hypothesis test is used:

${\displaystyle {\begin{cases}H_{0}:d=1\\H_{1}:d>1\end{cases}}}$

Likelihood-ratio test

The likelihood-ratio test statistic for ${\displaystyle \operatorname {NA} }$ is,

${\displaystyle W=2({\mathcal {L}}(X;\mu ,d)-{\mathcal {L}}(X;\mu ,1))}$

Where likelihood ${\displaystyle {\mathcal {L}}()}$ is the log-likelihood function. W does not have an asymptotic ${\displaystyle \chi _{1}^{2}}$ distribution as expected under the null hypothesis since d = 1 is at the parameter domain's edge. In the asymptotic distribution of W, it can be demonstrated that the constant 0 and ${\displaystyle \chi _{1}^{2}}$ have a 50:50 mixture. For this mixture, the ${\displaystyle \alpha }$ upper-tail percentage points are the same as the ${\displaystyle 2\alpha }$ upper-tail percentage points for a ${\displaystyle \chi _{1}^{2}}$

Related distributions

The poisson distribution (on { 0, 1, 2, 3, ... }) is a special case of the Neyman Type A distribution, with

${\displaystyle \operatorname {Pois} (\lambda )=\operatorname {NA} (\lambda ,\,0).\,}$

From moments of order 1 and 2 we can write the population mean and variance based on the parameters ${\displaystyle \lambda }$ and ${\displaystyle \phi }$.

${\displaystyle \mu =\lambda \phi }$

${\displaystyle \sigma ^{2}=\lambda \phi (1+\phi )}$

In the dispersion index d we observe that by substituting ${\displaystyle \mu }$ for the parametrized equation of order 1 and ${\displaystyle \sigma }$ for the one of order 2, we obtain ${\displaystyle d=1+\phi }$. Our variable Y is therefore distributed as a Poisson of parameter ${\displaystyle \lambda }$ when d approaches to 1.

Then we have that,

${\displaystyle \lim _{d\rightarrow 1}\operatorname {NA} (\lambda ,\,\phi )\rightarrow \operatorname {Pois} (\lambda )}$

Applications

Usage History

When the Neyman's type A species' reproduction results in clusters, a distribution has been used to characterize the dispersion of plants. This typically occurs when a species develops from offspring of parent plants or from seeds that fall close to the parent plant. However, Archibald (1948] ^[11] observed that there is insufficient data to infer the kind of reproduction from the type of fitted distribution. While Neyman type A produced positive results for plant distributions, Evans (1953] ^[3] showed that Negative binomial distribution produced positive results for insect distributions. Neyman type A distributions have also been studied in the context of ecology, and the results that unless the plant clusters are so compact as to not lie across the edge of the square used to pick sample locations, the distribution is unlikely to be applicable to plant populations. The compactness of the clusters is a hidden assumption in Neyman's original derivation of the distribution, according to Skellam (1958). ^[12] The results were shown to be significantly impacted by the square size selection.

In the context of bus driver accidents, Cresswell and Froggatt (1963) ^[4] derived the Neyman type A based on the following hypotheses:

1. Each driver is susceptible to "spells," the number of which is Poissonian for any given amount of time, with the same parameter ${\displaystyle \lambda }$ for all drivers.
2. A driver's performance during a spell is poor, and he is likely to experience a Poissonian number of collisions, with the same parameter ${\displaystyle \phi }$ for all drivers.
3. Each driver behaves independently.
4. No accidents can occur outside of a spell.

These assumptions lead to a Neyman type A distribution via the ${\displaystyle \operatorname {Pois(\lambda )} }$ and ${\displaystyle \operatorname {Pois(\phi )} }$ model. In contrast to their "short distribution," Cresswell and Froggatt called this one the "long distribution" because of its lengthy tail. According to Irwin(1964), a type A distribution can also be obtained by assuming that various drivers have different levels of proneness, or K. with probability:

${\displaystyle \operatorname {P(K=k\phi )} ={\frac {e^{-\lambda }\lambda ^{k}}{k!}}}$

• taking values ${\displaystyle ~0,~\phi ,~2\phi ,~3\phi ,~...}$

and that a driver with proneness k${\displaystyle \phi }$ has X accidents where:

${\displaystyle ~\operatorname {P(X=x|k\phi )} ={\frac {e^{-k\phi }(k\phi )^{x}}{x!}}}$

This is the ${\displaystyle ~\operatorname {Pois(k\phi )} \wedge \operatorname {Pois(\lambda )} }$ model with mixing over the values taken by K.

Distribution was also suggested in the application for the grouping of minority tents for food from 1965 to 1969. In this regard, it was predicted that only the clustering rates or the average number of entities per grouping needed to be approximated, rather than adjusting distributions on d very big data bases.

• The reference of the usage history. ^[1]

Calculating Neyman Type A probabilities in R

• The code below simulates 5000 instances of ${\displaystyle \operatorname {NA(\lambda ,\phi )} }$,

 rNeymanA <- function(n,lambda, phi){    r <- numeric()    for (j in 1:n) {       k = rpois(1,lambda)       r[j] <- sum(rpois(k,phi))     }    return(r)  }

• The mass function of recurring probabilities is implemented in R in order to estimate theoretical probabilities; we can see it below,

dNeyman.rec <- function(x, lambda, phi){  p <- numeric()  p[1]<- exp(-lambda + lambda*exp(-phi))  c <- lambda*phi*exp(-phi)  if(x == 0){    return(p[1])  }  else{    for (i in 1:x) {      suma = 0      for (r in 0:(i-1)) {        suma = suma + (phi^r)/(factorial(r))*p[i-r]      }      p[i+1] = (c/(i))*suma # +1 per l'R    }    res <- p[i+1]    return(res)  } }

We compare results between the relative frequencies obtained by the simulation and the probabilities computed by the p.m.f. . Given two values for the parameters ${\displaystyle \lambda =2}$ and ${\displaystyle \phi =1}$. It is displayed in the following table,

X	0	1	2	3	4	5	6	7	8
Estimated ${\displaystyle f_{i}}$	.271	.207	.187	.141	.082	.052	.028	.016	.008
Teoric ${\displaystyle P(X=x_{i})}$	.282	.207	.180	.129	.084	.051	.029	.016	.008

References

1. Johnson, N.L; Kemp, A.W; Kotz, S (2005). Univariate Discret Distributions. Canada: Wiley-Intersciencie. pp. 407–409. ISBN   0-471-27246-9.
2. Beall, G. (1940). "The fit and significance of contagious distributions when applied to observations on larval insects". Ecology. 21 (4): 460–474. Bibcode:1940Ecol...21..460B. doi:10.2307/1930285. JSTOR   1930285.
3. Evans, D.A. (1953). "Experimental evidence concerning contagious distributions in ecology". Biometrika. 40 (1–2): 186–211. doi:10.1093/biomet/40.1-2.186.
4. Creswell, W.L.; Froggatt, P. (1963). The Causation of Bus Driver Accidents. London: Oxford University Press.
5. Feller, W. (1943). "On a general class of "contagious" distributions". Annals of Mathematical Statistics. 14 (4): 389. doi:10.1214/aoms/1177731359.
6. Johnson, N.L; Kemp, A.W; Kotz, S (2005). Univariate Discret Distributions. Canada: Wiley-Intersciencie. p. 404.
7. Johnson, N.L; Kemp, A.W; Kotz, S (2005). "1.1.3". Univariate Discret Distributions. Canada: Wiley-Intersciencie.
8. "Índice de dispersión (Varianza a Razón media)". Statologos. April 18, 2022.
9. Shenton, L.R; Bowman, K.O (1977). "9.6.1". Maximum Likelihood Estimation in Small Samples. London: Griffin.
10. Shenton, L.R (1949). "On the efficiency of the method of moments and Neyman Type A Distribution". Biometrika. 36: 450–454. doi:10.1093/biomet/36.3-4.450. JSTOR   2332680.
11. Archibald, E.E.A. Plant populations I: A new application of Neyman's contagious distribution, Annals of Botany. London: Oxford University Press. pp. 221–235.
12. Skellam, J.G. (1958). "On the derivation and applicability of Neyman's type A distribution". Biometrika. 45 (1–2): 32–36. doi:10.1093/biomet/45.1-2.32.