# Tightness of measures

Last updated

In mathematics, tightness is a concept in measure theory. The intuitive idea is that a given collection of measures does not "escape to infinity".

## Definitions

Let ${\displaystyle (X,T)}$ be a Hausdorff space, and let ${\displaystyle \Sigma }$ be a σ-algebra on ${\displaystyle X}$ that contains the topology ${\displaystyle T}$. (Thus, every open subset of ${\displaystyle X}$ is a measurable set and ${\displaystyle \Sigma }$ is at least as fine as the Borel σ-algebra on ${\displaystyle X}$.) Let ${\displaystyle M}$ be a collection of (possibly signed or complex) measures defined on ${\displaystyle \Sigma }$. The collection ${\displaystyle M}$ is called tight (or sometimes uniformly tight) if, for any ${\displaystyle \varepsilon >0}$, there is a compact subset ${\displaystyle K_{\varepsilon }}$ of ${\displaystyle X}$ such that, for all measures ${\displaystyle \mu \in M}$,

${\displaystyle |\mu |(X\setminus K_{\varepsilon })<\varepsilon .}$

where ${\displaystyle |\mu |}$ is the total variation measure of ${\displaystyle \mu }$. Very often, the measures in question are probability measures, so the last part can be written as

${\displaystyle \mu (K_{\varepsilon })>1-\varepsilon .\,}$

If a tight collection ${\displaystyle M}$ consists of a single measure ${\displaystyle \mu }$, then (depending upon the author) ${\displaystyle \mu }$ may either be said to be a tight measure or to be an inner regular measure .

If ${\displaystyle Y}$ is an ${\displaystyle X}$-valued random variable whose probability distribution on ${\displaystyle X}$ is a tight measure then ${\displaystyle Y}$ is said to be a separable random variable or a Radon random variable.

## Examples

### Compact spaces

If ${\displaystyle X}$ is a metrisable compact space, then every collection of (possibly complex) measures on ${\displaystyle X}$ is tight. This is not necessarily so for non-metrisable compact spaces. If we take ${\displaystyle [0,\omega _{1}]}$ with its order topology, then there exists a measure ${\displaystyle \mu }$ on it that is not inner regular. Therefore, the singleton ${\displaystyle \{\mu \}}$ is not tight.

### Polish spaces

If ${\displaystyle X}$ is a compact Polish space, then every probability measure on ${\displaystyle X}$ is tight. Furthermore, by Prokhorov's theorem, a collection of probability measures on ${\displaystyle X}$ is tight if and only if it is precompact in the topology of weak convergence.

### A collection of point masses

Consider the real line ${\displaystyle \mathbb {R} }$ with its usual Borel topology. Let ${\displaystyle \delta _{x}}$ denote the Dirac measure, a unit mass at the point ${\displaystyle x}$ in ${\displaystyle \mathbb {R} }$. The collection

${\displaystyle M_{1}:=\{\delta _{n}|n\in \mathbb {N} \}}$

is not tight, since the compact subsets of ${\displaystyle \mathbb {R} }$ are precisely the closed and bounded subsets, and any such set, since it is bounded, has ${\displaystyle \delta _{n}}$-measure zero for large enough ${\displaystyle n}$. On the other hand, the collection

${\displaystyle M_{2}:=\{\delta _{1/n}|n\in \mathbb {N} \}}$

is tight: the compact interval ${\displaystyle [0,1]}$ will work as ${\displaystyle K_{\varepsilon }}$ for any ${\displaystyle \varepsilon >0}$. In general, a collection of Dirac delta measures on ${\displaystyle \mathbb {R} ^{n}}$ is tight if, and only if, the collection of their supports is bounded.

### A collection of Gaussian measures

Consider ${\displaystyle n}$-dimensional Euclidean space ${\displaystyle \mathbb {R} ^{n}}$ with its usual Borel topology and σ-algebra. Consider a collection of Gaussian measures

${\displaystyle \Gamma =\{\gamma _{i}|i\in I\},}$

where the measure ${\displaystyle \gamma _{i}}$ has expected value (mean) ${\displaystyle m_{i}\in \mathbb {R} ^{n}}$ and covariance matrix ${\displaystyle C_{i}\in \mathbb {R} ^{n\times n}}$. Then the collection ${\displaystyle \Gamma }$ is tight if, and only if, the collections ${\displaystyle \{m_{i}|i\in I\}\subseteq \mathbb {R} ^{n}}$ and ${\displaystyle \{C_{i}|i\in I\}\subseteq \mathbb {R} ^{n\times n}}$ are both bounded.

## Tightness and convergence

Tightness is often a necessary criterion for proving the weak convergence of a sequence of probability measures, especially when the measure space has infinite dimension. See

## Exponential tightness

A strengthening of tightness is the concept of exponential tightness, which has applications in large deviations theory. A family of probability measures ${\displaystyle (\mu _{\delta })_{\delta >0}}$ on a Hausdorff topological space ${\displaystyle X}$ is said to be exponentially tight if, for any ${\displaystyle \varepsilon >0}$, there is a compact subset ${\displaystyle K_{\varepsilon }}$ of ${\displaystyle X}$ such that

${\displaystyle \limsup _{\delta \downarrow 0}\delta \log \mu _{\delta }(X\setminus K_{\varepsilon })<-\varepsilon .}$

## Related Research Articles

In mathematics, specifically in measure theory, a Borel measure on a topological space is a measure that is defined on all open sets. Some authors require additional restrictions on the measure, as described below.

In mathematical physics and mathematics, the Pauli matrices are a set of three 2 × 2 complex matrices which are Hermitian and unitary. Usually indicated by the Greek letter sigma, they are occasionally denoted by tau when used in connection with isospin symmetries. They are

In mathematical analysis, the Haar measure assigns an "invariant volume" to subsets of locally compact topological groups, consequently defining an integral for functions on those groups.

Noether's theorem or Noether's first theorem states that every differentiable symmetry of the action of a physical system has a corresponding conservation law. The theorem was proven by mathematician Emmy Noether in 1915 and published in 1918, after a special case was proven by E. Cosserat and F. Cosserat in 1909. The action of a physical system is the integral over time of a Lagrangian function, from which the system's behavior can be determined by the principle of least action. This theorem only applies to continuous and smooth symmetries over physical space.

In calculus, absolute continuity is a smoothness property of functions that is stronger than continuity and uniform continuity. The notion of absolute continuity allows one to obtain generalizations of the relationship between the two central operations of calculus—differentiation and integration. This relationship is commonly characterized in the framework of Riemann integration, but with absolute continuity it may be formulated in terms of Lebesgue integration. For real-valued functions on the real line, two interrelated notions appear: absolute continuity of functions and absolute continuity of measures. These two notions are generalized in different directions. The usual derivative of a function is related to the Radon–Nikodym derivative, or density, of a measure.

In mathematics, the Radon–Nikodym theorem is a result in measure theory that expresses the relationship between two measures defined on the same measurable space. A measure is a set function that assigns a consistent magnitude to the measurable subsets of a measurable space. Examples of a measure include area and volume, where the subsets are sets of points; or the probability of an event, which is a subset of possible outcomes within a wider probability space.

In mathematics, the support of a real-valued function f is the subset of the domain containing the elements which are not mapped to zero. If the domain of f is a topological space, the support of f is instead defined as the smallest closed set containing all points not mapped to zero. This concept is used very widely in mathematical analysis.

In probability theory, the Chernoff bound, named after Herman Chernoff but due to Herman Rubin, gives exponentially decreasing bounds on tail distributions of sums of independent random variables. It is a sharper bound than the known first- or second-moment-based tail bounds such as Markov's inequality or Chebyshev's inequality, which only yield power-law bounds on tail decay. However, the Chernoff bound requires that the variates be independent – a condition that neither Markov's inequality nor Chebyshev's inequality require, although Chebyshev's inequality does require the variates to be pairwise independent.

In measure theory Prokhorov's theorem relates tightness of measures to relative compactness in the space of probability measures. It is credited to the Soviet mathematician Yuri Vasilyevich Prokhorov, who considered probability measures on complete separable metric spaces. The term "Prokhorov’s theorem" is also applied to later generalizations to either the direct or the inverse statements.

In mathematics, the support of a measure μ on a measurable topological space is a precise notion of where in the space X the measure "lives". It is defined to be the largest (closed) subset of X for which every open neighbourhood of every point of the set has positive measure.

In mathematics, an inner regular measure is one for which the measure of a set can be approximated from within by compact subsets.

In mathematics, the Lévy–Prokhorov metric is a metric on the collection of probability measures on a given metric space. It is named after the French mathematician Paul Lévy and the Soviet mathematician Yuri Vasilyevich Prokhorov; Prokhorov introduced it in 1956 as a generalization of the earlier Lévy metric.

In mathematics, classical Wiener space is the collection of all continuous functions on a given domain, taking values in a metric space. Classical Wiener space is useful in the study of stochastic processes whose sample paths are continuous functions. It is named after the American mathematician Norbert Wiener.

In mathematics, more specifically measure theory, there are various notions of the convergence of measures. For an intuitive general sense of what is meant by convergence in measure, consider a sequence of measures μn on a space, sharing a common collection of measurable sets. Such a sequence might represent an attempt to construct 'better and better' approximations to a desired measure μ that is difficult to obtain directly. The meaning of 'better and better' is subject to all the usual caveats for taking limits; for any error tolerance ε > 0 we require there be N sufficiently large for nN to ensure the 'difference' between μn and μ is smaller than ε. Various notions of convergence specify precisely what the word 'difference' should mean in that description; these notions are not equivalent to one another, and vary in strength.

Convergence in measure is either of two distinct mathematical concepts both of which generalize the concept of convergence in probability.

In mathematics, uniform integrability is an important concept in real analysis, functional analysis and measure theory, and plays a vital role in the theory of martingales. The definition used in measure theory is closely related to, but not identical to, the definition typically used in probability.

In real analysis and measure theory, the Vitali convergence theorem, named after the Italian mathematician Giuseppe Vitali, is a generalization of the better-known dominated convergence theorem of Henri Lebesgue. It is a characterization of the convergence in Lp in terms of convergence in measure and a condition related to uniform integrability.

In mathematics, and especially topology, a Poincaré complex is an abstraction of the singular chain complex of a closed, orientable manifold.

In mathematics, a càdlàg, RCLL, or corlol function is a function defined on the real numbers that is everywhere right-continuous and has left limits everywhere. Càdlàg functions are important in the study of stochastic processes that admit jumps, unlike Brownian motion, which has continuous sample paths. The collection of càdlàg functions on a given domain is known as Skorokhod space.

In mathematics, the injective tensor product of two topological vector spaces (TVSs) was introduced by Alexander Grothendieck and was used by him to define nuclear spaces. An injective tensor product is in general not necessarily complete, so its completion is called the completed injective tensor products. Injective tensor products have applications outside of nuclear spaces. In particular, as described below, up to TVS-isomorphism, many TVSs that are defined for real or complex valued functions, for instance, the Schwartz space or the space of continuously differentiable functions, can be immediately extended to functions valued in a Hausdorff locally convex TVS Y without any need to extend definitions from real/complex-valued functions to Y-valued functions.

## References

• Billingsley, Patrick (1995). Probability and Measure. New York, NY: John Wiley & Sons, Inc. ISBN   0-471-00710-2.
• Billingsley, Patrick (1999). . New York, NY: John Wiley & Sons, Inc. ISBN   0-471-19745-9.
• Ledoux, Michel; Talagrand, Michel (1991). Probability in Banach spaces. Berlin: Springer-Verlag. pp. xii+480. ISBN   3-540-52013-9. MR 1102015 (See chapter 2)