Probability density function Pareto Type I probability density functions for various with As the distribution approaches where is the Dirac delta function. | |||
Cumulative distribution function Pareto Type I cumulative distribution functions for various with | |||
Parameters | scale (real) shape (real) | ||
---|---|---|---|
Support | |||
CDF | |||
Quantile | |||
Mean | |||
Median | |||
Mode | |||
Variance | |||
Skewness | |||
Excess kurtosis | |||
Entropy | |||
MGF | does not exist | ||
CF | |||
Fisher information | |||
Expected shortfall | [1] |
The Pareto distribution, named after the Italian civil engineer, economist, and sociologist Vilfredo Pareto, [2] is a power-law probability distribution that is used in description of social, quality control, scientific, geophysical, actuarial, and many other types of observable phenomena; the principle originally applied to describing the distribution of wealth in a society, fitting the trend that a large portion of wealth is held by a small fraction of the population. [3] [4] The Pareto principle or "80-20 rule" stating that 80% of outcomes are due to 20% of causes was named in honour of Pareto, but the concepts are distinct, and only Pareto distributions with shape value (α) of log45 ≈ 1.16 precisely reflect it. Empirical observation has shown that this 80-20 distribution fits a wide range of cases, including natural phenomena [5] and human activities. [6] [7]
If X is a random variable with a Pareto (Type I) distribution, [8] then the probability that X is greater than some number x, i.e., the survival function (also called tail function), is given by
where xm is the (necessarily positive) minimum possible value of X, and α is a positive parameter. The type I Pareto distribution is characterized by a scale parameter xm and a shape parameter α, which is known as the tail index. If this distribution is used to model the distribution of wealth, then the parameter α is called the Pareto index.
From the definition, the cumulative distribution function of a Pareto random variable with parameters α and xm is
It follows (by differentiation) that the probability density function is
When plotted on linear axes, the distribution assumes the familiar J-shaped curve which approaches each of the orthogonal axes asymptotically. All segments of the curve are self-similar (subject to appropriate scaling factors). When plotted in a log-log plot, the distribution is represented by a straight line.
Thus, since the expectation does not converge on an open interval containing we say that the moment generating function does not exist.
The parameters may be solved for using the method of moments. [9]
The conditional probability distribution of a Pareto-distributed random variable, given the event that it is greater than or equal to a particular number exceeding , is a Pareto distribution with the same Pareto index but with minimum instead of :
This implies that the conditional expected value (if it is finite, i.e. ) is proportional to :
In case of random variables that describe the lifetime of an object, this means that life expectancy is proportional to age, and is called the Lindy effect or Lindy's Law. [10]
Suppose are independent identically distributed random variables whose probability distribution is supported on the interval for some . Suppose that for all , the two random variables and are independent. Then the common distribution is a Pareto distribution.[ citation needed ]
The geometric mean (G) is [11]
The harmonic mean (H) is [11]
The characteristic curved 'long tail' distribution, when plotted on a linear scale, masks the underlying simplicity of the function when plotted on a log-log graph, which then takes the form of a straight line with negative gradient: It follows from the formula for the probability density function that for x ≥ xm,
Since α is positive, the gradient −(α + 1) is negative.
There is a hierarchy [8] [12] of Pareto distributions known as Pareto Type I, II, III, IV, and Feller–Pareto distributions. [8] [12] [13] Pareto Type IV contains Pareto Type I–III as special cases. The Feller–Pareto [12] [14] distribution generalizes Pareto Type IV.
The Pareto distribution hierarchy is summarized in the next table comparing the survival functions (complementary CDF).
When μ = 0, the Pareto distribution Type II is also known as the Lomax distribution. [15]
In this section, the symbol xm, used before to indicate the minimum value of x, is replaced by σ.
Support | Parameters | ||
---|---|---|---|
Type I | |||
Type II | |||
Lomax | |||
Type III | |||
Type IV | |||
The shape parameter α is the tail index, μ is location, σ is scale, γ is an inequality parameter. Some special cases of Pareto Type (IV) are
The finiteness of the mean, and the existence and the finiteness of the variance depend on the tail index α (inequality index γ). In particular, fractional δ-moments are finite for some δ > 0, as shown in the table below, where δ is not necessarily an integer.
Condition | Condition | |||
---|---|---|---|---|
Type I | ||||
Type II | ||||
Type III | ||||
Type IV | ||||
Feller [12] [14] defines a Pareto variable by transformation U = Y−1 − 1 of a beta random variable ,Y, whose probability density function is
where B( ) is the beta function. If
then W has a Feller–Pareto distribution FP(μ, σ, γ, γ1, γ2). [8]
If and are independent Gamma variables, another construction of a Feller–Pareto (FP) variable is [16]
and we write W ~ FP(μ, σ, γ, δ1, δ2). Special cases of the Feller–Pareto distribution are
When a random variable follows a pareto distribution, then its inverse follows an Inverse Pareto distribution. Inverse Pareto distribution is equivalent to a Power distribution [17]
The Pareto distribution is related to the exponential distribution as follows. If X is Pareto-distributed with minimum xm and index α, then
is exponentially distributed with rate parameter α. Equivalently, if Y is exponentially distributed with rate α, then
is Pareto-distributed with minimum xm and index α.
This can be shown using the standard change-of-variable techniques:
The last expression is the cumulative distribution function of an exponential distribution with rate α.
Pareto distribution can be constructed by hierarchical exponential distributions. [18] Let and . Then we have and, as a result, .
More in general, if (shape-rate parametrization) and , then .
Equivalently, if and , then .
The Pareto distribution and log-normal distribution are alternative distributions for describing the same types of quantities. One of the connections between the two is that they are both the distributions of the exponential of random variables distributed according to other common distributions, respectively the exponential distribution and normal distribution. (See the previous section.)
The Pareto distribution is a special case of the generalized Pareto distribution, which is a family of distributions of similar form, but containing an extra parameter in such a way that the support of the distribution is either bounded below (at a variable point), or bounded both above and below (where both are variable), with the Lomax distribution as a special case. This family also contains both the unshifted and shifted exponential distributions.
The Pareto distribution with scale and shape is equivalent to the generalized Pareto distribution with location , scale and shape and, conversely, one can get the Pareto distribution from the GPD by taking and if .
Parameters | location (real) | ||
---|---|---|---|
Support | |||
CDF | |||
Mean | |||
Median | |||
Variance | (this is the second raw moment, not the variance) | ||
Skewness | (this is the kth raw moment, not the skewness) |
The bounded (or truncated) Pareto distribution has three parameters: α, L and H. As in the standard Pareto distribution α determines the shape. L denotes the minimal value, and H denotes the maximal value.
The probability density function is
where L ≤ x ≤ H, and α > 0.
If U is uniformly distributed on (0, 1), then applying inverse-transform method [19]
is a bounded Pareto-distributed.
The purpose of the Symmetric and Zero Symmetric Pareto distributions is to capture some special statistical distribution with a sharp probability peak and symmetric long probability tails. These two distributions are derived from the Pareto distribution. Long probability tails normally means that probability decays slowly, and can be used to fit a variety of datasets. But if the distribution has symmetric structure with two slow decaying tails, Pareto could not do it. Then Symmetric Pareto or Zero Symmetric Pareto distribution is applied instead. [20]
The Cumulative distribution function (CDF) of Symmetric Pareto distribution is defined as following: [20]
The corresponding probability density function (PDF) is: [20]
This distribution has two parameters: a and b. It is symmetric about b. Then the mathematic expectation is b. When, it has variance as following:
The CDF of Zero Symmetric Pareto (ZSP) distribution is defined as following:
The corresponding PDF is:
This distribution is symmetric about zero. Parameter a is related to the decay rate of probability and (a/2b) represents peak magnitude of probability. [20]
The univariate Pareto distribution has been extended to a multivariate Pareto distribution. [21]
The likelihood function for the Pareto distribution parameters α and xm, given an independent sample x = (x1, x2, ..., xn), is
Therefore, the logarithmic likelihood function is
It can be seen that is monotonically increasing with xm, that is, the greater the value of xm, the greater the value of the likelihood function. Hence, since x ≥ xm, we conclude that
To find the estimator for α, we compute the corresponding partial derivative and determine where it is zero:
Thus the maximum likelihood estimator for α is:
The expected statistical error is: [22]
Malik (1970) [23] gives the exact joint distribution of . In particular, and are independent and is Pareto with scale parameter xm and shape parameter nα, whereas has an inverse-gamma distribution with shape and scale parameters n − 1 and nα, respectively.
Vilfredo Pareto originally used this distribution to describe the allocation of wealth among individuals since it seemed to show rather well the way that a larger portion of the wealth of any society is owned by a smaller percentage of the people in that society. He also used it to describe distribution of income. [4] This idea is sometimes expressed more simply as the Pareto principle or the "80-20 rule" which says that 20% of the population controls 80% of the wealth. [24] As Michael Hudson points out (The Collapse of Antiquity [2023] p. 85 & n.7) "a mathematical corollary [is] that 10% would have 65% of the wealth, and 5% would have half the national wealth.” However, the 80-20 rule corresponds to a particular value of α, and in fact, Pareto's data on British income taxes in his Cours d'économie politique indicates that about 30% of the population had about 70% of the income.[ citation needed ] The probability density function (PDF) graph at the beginning of this article shows that the "probability" or fraction of the population that owns a small amount of wealth per person is rather high, and then decreases steadily as wealth increases. (The Pareto distribution is not realistic for wealth for the lower end, however. In fact, net worth may even be negative.) This distribution is not limited to describing wealth or income, but to many situations in which an equilibrium is found in the distribution of the "small" to the "large". The following examples are sometimes seen as approximately Pareto-distributed:
The Pareto distribution is a continuous probability distribution. Zipf's law, also sometimes called the zeta distribution, is a discrete distribution, separating the values into a simple ranking. Both are a simple power law with a negative exponent, scaled so that their cumulative distributions equal 1. Zipf's can be derived from the Pareto distribution if the values (incomes) are binned into ranks so that the number of people in each bin follows a 1/rank pattern. The distribution is normalized by defining so that where is the generalized harmonic number. This makes Zipf's probability density function derivable from Pareto's.
where and is an integer representing rank from 1 to N where N is the highest income bracket. So a randomly selected person (or word, website link, or city) from a population (or language, internet, or country) has probability of ranking .
The "80–20 law", according to which 20% of all people receive 80% of all income, and 20% of the most affluent 20% receive 80% of that 80%, and so on, holds precisely when the Pareto index is . This result can be derived from the Lorenz curve formula given below. Moreover, the following have been shown [34] to be mathematically equivalent:
This does not apply only to income, but also to wealth, or to anything else that can be modeled by this distribution.
This excludes Pareto distributions in which 0 < α ≤ 1, which, as noted above, have an infinite expected value, and so cannot reasonably model income distribution.
Price's square root law is sometimes offered as a property of or as similar to the Pareto distribution. However, the law only holds in the case that . Note that in this case, the total and expected amount of wealth are not defined, and the rule only applies asymptotically to random samples. The extended Pareto Principle mentioned above is a far more general rule.
The Lorenz curve is often used to characterize income and wealth distributions. For any distribution, the Lorenz curve L(F) is written in terms of the PDF f or the CDF F as
where x(F) is the inverse of the CDF. For the Pareto distribution,
and the Lorenz curve is calculated to be
For the denominator is infinite, yielding L=0. Examples of the Lorenz curve for a number of Pareto distributions are shown in the graph on the right.
According to Oxfam (2016) the richest 62 people have as much wealth as the poorest half of the world's population. [35] We can estimate the Pareto index that would apply to this situation. Letting ε equal we have:
or
The solution is that α equals about 1.15, and about 9% of the wealth is owned by each of the two groups. But actually the poorest 69% of the world adult population owns only about 3% of the wealth. [36]
The Gini coefficient is a measure of the deviation of the Lorenz curve from the equidistribution line which is a line connecting [0, 0] and [1, 1], which is shown in black (α = ∞) in the Lorenz plot on the right. Specifically, the Gini coefficient is twice the area between the Lorenz curve and the equidistribution line. The Gini coefficient for the Pareto distribution is then calculated (for ) to be
(see Aaberge 2005).
Random samples can be generated using inverse transform sampling. Given a random variate U drawn from the uniform distribution on the unit interval [0, 1], the variate T given by
is Pareto-distributed. [37]
In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the distance between events in a Poisson point process, i.e., a process in which events occur continuously and independently at a constant average rate; the distance parameter could be any meaningful mono-dimensional measure of the process, such as time between production errors, or length along a roll of fabric in the weaving manufacturing process. It is a particular case of the gamma distribution. It is the continuous analogue of the geometric distribution, and it has the key property of being memoryless. In addition to being used for the analysis of Poisson point processes it is found in various other contexts.
In probability theory and statistics, the Weibull distribution is a continuous probability distribution. It models a broad range of random variables, largely in the nature of a time to failure or time between events. Examples are maximum one-day rainfalls and the time a user spends on a web page.
In probability theory and statistics, the beta distribution is a family of continuous probability distributions defined on the interval [0, 1] or in terms of two positive parameters, denoted by alpha (α) and beta (β), that appear as exponents of the variable and its complement to 1, respectively, and control the shape of the distribution.
In probability theory and statistics, the gamma distribution is a versatile two-parameter family of continuous probability distributions. The exponential distribution, Erlang distribution, and chi-squared distribution are special cases of the gamma distribution. There are two equivalent parameterizations in common use:
In probability theory and statistics, the Rayleigh distribution is a continuous probability distribution for nonnegative-valued random variables. Up to rescaling, it coincides with the chi distribution with two degrees of freedom. The distribution is named after Lord Rayleigh.
In probability theory and statistics, the Gumbel distribution is used to model the distribution of the maximum of a number of samples of various distributions.
In probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It resembles the normal distribution in shape but has heavier tails. The logistic distribution is a special case of the Tukey lambda distribution.
In probability theory and statistics, the generalized extreme value (GEV) distribution is a family of continuous probability distributions developed within extreme value theory to combine the Gumbel, Fréchet and Weibull families also known as type I, II and III extreme value distributions. By the extreme value theorem the GEV distribution is the only possible limit distribution of properly normalized maxima of a sequence of independent and identically distributed random variables. Note that a limit distribution needs to exist, which requires regularity conditions on the tail of the distribution. Despite this, the GEV distribution is often used as an approximation to model the maxima of long (finite) sequences of random variables.
The Pearson distribution is a family of continuous probability distributions. It was first published by Karl Pearson in 1895 and subsequently extended by him in 1901 and 1916 in a series of articles on biostatistics.
In statistics and information theory, a maximum entropy probability distribution has entropy that is at least as great as that of all other members of a specified class of probability distributions. According to the principle of maximum entropy, if nothing is known about a distribution except that it belongs to a certain class, then the distribution with the largest entropy should be chosen as the least-informative default. The motivation is twofold: first, maximizing entropy minimizes the amount of prior information built into the distribution; second, many physical systems tend to move towards maximal entropy configurations over time.
In probability theory and statistics, the beta prime distribution is an absolutely continuous probability distribution. If has a beta distribution, then the odds has a beta prime distribution.
In statistics, the multivariate t-distribution is a multivariate probability distribution. It is a generalization to random vectors of the Student's t-distribution, which is a distribution applicable to univariate random variables. While the case of a random matrix could be treated within this structure, the matrix t-distribution is distinct and makes particular use of the matrix structure.
Expected shortfall (ES) is a risk measure—a concept used in the field of financial risk measurement to evaluate the market risk or credit risk of a portfolio. The "expected shortfall at q% level" is the expected return on the portfolio in the worst of cases. ES is an alternative to value at risk that is more sensitive to the shape of the tail of the loss distribution.
In statistics, the generalized Pareto distribution (GPD) is a family of continuous probability distributions. It is often used to model the tails of another distribution. It is specified by three parameters: location , scale , and shape . Sometimes it is specified by only scale and shape and sometimes only by its shape parameter. Some references give the shape parameter as .
A ratio distribution is a probability distribution constructed as the distribution of the ratio of random variables having two other known distributions. Given two random variables X and Y, the distribution of the random variable Z that is formed as the ratio Z = X/Y is a ratio distribution.
In financial mathematics, tail value at risk (TVaR), also known as tail conditional expectation (TCE) or conditional tail expectation (CTE), is a risk measure associated with the more general value at risk. It quantifies the expected value of the loss given that an event outside a given probability level has occurred.
The shifted log-logistic distribution is a probability distribution also known as the generalized log-logistic or the three-parameter log-logistic distribution. It has also been called the generalized logistic distribution, but this conflicts with other uses of the term: see generalized logistic distribution.
The term generalized logistic distribution is used as the name for several different families of probability distributions. For example, Johnson et al. list four forms, which are listed below.
In probability theory and statistics, the normal-inverse-gamma distribution is a four-parameter family of multivariate continuous probability distributions. It is the conjugate prior of a normal distribution with unknown mean and variance.
The Lomax distribution, conditionally also called the Pareto Type II distribution, is a heavy-tail probability distribution used in business, economics, actuarial science, queueing theory and Internet traffic modeling. It is named after K. S. Lomax. It is essentially a Pareto distribution that has been shifted so that its support begins at zero.
We experimented with 5 different distributions (Geometric, Weibull, Rayleigh, Pareto, and Lognormal), that are commonly used in the context of system reliability, and evaluated their fit through the total squared differences between the actual and hypothesized frequencies (χ2 statistic). We found consistently across all models that the geometric distribution is a poor fit, while the Pareto distribution provides the best fit.
{{cite journal}}
: Cite journal requires |journal=
(help)