# Mechanism design

Last updated

Mechanism design is a field in economics and game theory that takes an objectives-first approach to designing economic mechanisms or incentives, toward desired objectives, in strategic settings, where players act rationally. Because it starts at the end of the game, then goes backwards, it is also called reverse game theory. It has broad applications, from economics and politics (markets, auctions, voting procedures) to networked-systems (internet interdomain routing, sponsored search auctions).

## Contents

Mechanism design studies solution concepts for a class of private-information games. Leonid Hurwicz explains that 'in a design problem, the goal function is the main "given", while the mechanism is the unknown. Therefore, the design problem is the "inverse" of traditional economic theory, which is typically devoted to the analysis of the performance of a given mechanism.' [1] So, two distinguishing features of these games are:

• that a game "designer" chooses the game structure rather than inheriting one
• that the designer is interested in the game's outcome

The 2007 Nobel Memorial Prize in Economic Sciences was awarded to Leonid Hurwicz, Eric Maskin, and Roger Myerson "for having laid the foundations of mechanism design theory". [2]

## Intuition

In an interesting class of Bayesian games, one player, called the "principal", would like to condition his behavior on information privately known to other players. For example, the principal would like to know the true quality of a used car a salesman is pitching. He cannot learn anything simply by asking the salesman, because it is in the salesman's interest to distort the truth. However, in mechanism design the principal does have one advantage: He may design a game whose rules can influence others to act the way he would like.

Without mechanism design theory, the principal's problem would be difficult to solve. He would have to consider all the possible games and choose the one that best influences other players' tactics. In addition, the principal would have to draw conclusions from agents who may lie to him. Thanks to mechanism design, and particularly the revelation principle, the principal only needs to consider games in which agents truthfully report their private information.

## Foundations

### Mechanism

A game of mechanism design is a game of private information in which one of the agents, called the principal, chooses the payoff structure. Following Harsanyi  ( 1967 ), the agents receive secret "messages" from nature containing information relevant to payoffs. For example, a message may contain information about their preferences or the quality of a good for sale. We call this information the agent's "type" (usually noted ${\displaystyle \theta }$ and accordingly the space of types ${\displaystyle \Theta }$). Agents then report a type to the principal (usually noted with a hat ${\displaystyle {\hat {\theta }}}$) that can be a strategic lie. After the report, the principal and the agents are paid according to the payoff structure the principal chose.

The timing of the game is:

1. The principal commits to a mechanism ${\displaystyle y()}$ that grants an outcome ${\displaystyle y}$ as a function of reported type
2. The agents report, possibly dishonestly, a type profile ${\displaystyle {\hat {\theta }}}$
3. The mechanism is executed (agents receive outcome ${\displaystyle y({\hat {\theta }})}$)

In order to understand who gets what, it is common to divide the outcome ${\displaystyle y}$ into a goods allocation and a money transfer, ${\displaystyle y(\theta )=\{x(\theta ),t(\theta )\},\ x\in X,t\in T}$ where ${\displaystyle x}$ stands for an allocation of goods rendered or received as a function of type, and ${\displaystyle t}$ stands for a monetary transfer as a function of type.

As a benchmark the designer often defines what would happen under full information. Define a social choice function${\displaystyle f(\theta )}$ mapping the (true) type profile directly to the allocation of goods received or rendered,

${\displaystyle f(\theta ):\Theta \rightarrow X}$

In contrast a mechanism maps the reported type profile to an outcome (again, both a goods allocation ${\displaystyle x}$ and a money transfer ${\displaystyle t}$)

${\displaystyle y({\hat {\theta }}):\Theta \rightarrow Y}$

### Revelation principle

A proposed mechanism constitutes a Bayesian game (a game of private information), and if it is well-behaved the game has a Bayesian Nash equilibrium. At equilibrium agents choose their reports strategically as a function of type

${\displaystyle {\hat {\theta }}(\theta )}$

It is difficult to solve for Bayesian equilibria in such a setting because it involves solving for agents' best-response strategies and for the best inference from a possible strategic lie. Thanks to a sweeping result called the revelation principle, no matter the mechanism a designer can [3] confine attention to equilibria in which agents truthfully report type. The revelation principle states: "To every Bayesian Nash equilibrium there corresponds a Bayesian game with the same equilibrium outcome but in which players truthfully report type."

This is extremely useful. The principle allows one to solve for a Bayesian equilibrium by assuming all players truthfully report type (subject to an incentive compatibility constraint). In one blow it eliminates the need to consider either strategic behavior or lying.

Its proof is quite direct. Assume a Bayesian game in which the agent's strategy and payoff are functions of its type and what others do, ${\displaystyle u_{i}\left(s_{i}(\theta _{i}),s_{-i}(\theta _{-i}),\theta _{i}\right)}$. By definition agent i's equilibrium strategy ${\displaystyle s(\theta _{i})}$ is Nash in expected utility:

${\displaystyle s_{i}(\theta _{i})\in \arg \max _{s'_{i}\in S_{i}}\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(s'_{i},s_{-i}(\theta _{-i}),\theta _{i}\right)}$

Simply define a mechanism that would induce agents to choose the same equilibrium. The easiest one to define is for the mechanism to commit to playing the agents' equilibrium strategies for them.

${\displaystyle y({\hat {\theta }}):\Theta \rightarrow S(\Theta )\rightarrow Y}$

Under such a mechanism the agents of course find it optimal to reveal type since the mechanism plays the strategies they found optimal anyway. Formally, choose ${\displaystyle y(\theta )}$ such that

{\displaystyle {\begin{aligned}\theta _{i}\in {}&\arg \max _{\theta '_{i}\in \Theta }\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(y(\theta '_{i},\theta _{-i}),\theta _{i}\right)\\[5pt]&=\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(s_{i}(\theta ),s_{-i}(\theta _{-i}),\theta _{i}\right)\end{aligned}}}

### Implementability

The designer of a mechanism generally hopes either

• to design a mechanism ${\displaystyle y()}$ that "implements" a social choice function
• to find the mechanism ${\displaystyle y()}$ that maximizes some value criterion (e.g. profit)

To implement a social choice function ${\displaystyle f(\theta )}$ is to find some ${\displaystyle t(\theta )}$ transfer function that motivates agents to pick outcome ${\displaystyle x(\theta )}$. Formally, if the equilibrium strategy profile under the mechanism maps to the same goods allocation as a social choice function,

${\displaystyle f(\theta )=x\left({\hat {\theta }}(\theta )\right)}$

we say the mechanism implements the social choice function.

Thanks to the revelation principle, the designer can usually find a transfer function ${\displaystyle t(\theta )}$ to implement a social choice by solving an associated truthtelling game. If agents find it optimal to truthfully report type,

${\displaystyle {\hat {\theta }}(\theta )=\theta }$

we say such a mechanism is truthfully implementable (or just "implementable"). The task is then to solve for a truthfully implementable ${\displaystyle t(\theta )}$ and impute this transfer function to the original game. An allocation ${\displaystyle x(\theta )}$ is truthfully implementable if there exists a transfer function ${\displaystyle t(\theta )}$ such that

${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq u(x({\hat {\theta }}),t({\hat {\theta }}),\theta )\ \forall \theta ,{\hat {\theta }}\in \Theta }$

which is also called the incentive compatibility (IC) constraint.

In applications, the IC condition is the key to describing the shape of ${\displaystyle t(\theta )}$ in any useful way. Under certain conditions it can even isolate the transfer function analytically. Additionally, a participation (individual rationality) constraint is sometimes added if agents have the option of not playing.

#### Necessity

Consider a setting in which all agents have a type-contingent utility function ${\displaystyle u(x,t,\theta )}$. Consider also a goods allocation ${\displaystyle x(\theta )}$ that is vector-valued and size ${\displaystyle k}$ (which permits ${\displaystyle k}$ number of goods) and assume it is piecewise continuous with respect to its arguments.

The function ${\displaystyle x(\theta )}$ is implementable only if

${\displaystyle \sum _{k=1}^{n}{\frac {\partial }{\partial \theta }}\left({\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}\right){\frac {\partial x}{\partial \theta }}\geq 0}$

whenever ${\displaystyle x=x(\theta )}$ and ${\displaystyle t=t(\theta )}$ and x is continuous at ${\displaystyle \theta }$. This is a necessary condition and is derived from the first- and second-order conditions of the agent's optimization problem assuming truth-telling.

Its meaning can be understood in two pieces. The first piece says the agent's marginal rate of substitution (MRS) increases as a function of the type,

${\displaystyle {\frac {\partial }{\partial \theta }}\left({\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}\right)={\frac {\partial }{\partial \theta }}\mathrm {MRS} _{x,t}}$

In short, agents will not tell the truth if the mechanism does not offer higher agent types a better deal. Otherwise, higher types facing any mechanism that punishes high types for reporting will lie and declare they are lower types, violating the truthtelling IC constraint. The second piece is a monotonicity condition waiting to happen,

${\displaystyle {\frac {\partial x}{\partial \theta }}}$

which, to be positive, means higher types must be given more of the good.

There is potential for the two pieces to interact. If for some type range the contract offered less quantity to higher types ${\displaystyle \partial x/\partial \theta <0}$, it is possible the mechanism could compensate by giving higher types a discount. But such a contract already exists for low-type agents, so this solution is pathological. Such a solution sometimes occurs in the process of solving for a mechanism. In these cases it must be "ironed." In a multiple-good environment it is also possible for the designer to reward the agent with more of one good to substitute for less of another (e.g. butter for margarine). Multiple-good mechanisms are an ongoing problem in mechanism design theory.

#### Sufficiency

Mechanism design papers usually make two assumptions to ensure implementability:

${\displaystyle 1.\ {\frac {\partial }{\partial \theta }}{\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}>0\ \forall k}$

This is known by several names: the single-crossing condition, the sorting condition and the Spence–Mirrlees condition. It means the utility function is of such a shape that the agent's MRS is increasing in type.

${\displaystyle 2.\ \exists K_{0},K_{1}{\text{ such that }}\left|{\frac {\partial u/\partial x_{k}}{\partial u/\partial t}}\right|\leq K_{0}+K_{1}|t|}$

This is a technical condition bounding the rate of growth of the MRS.

These assumptions are sufficient to provide that any monotonic ${\displaystyle x(\theta )}$ is implementable (a ${\displaystyle t(\theta )}$ exists that can implement it). In addition, in the single-good setting the single-crossing condition is sufficient to provide that only a monotonic ${\displaystyle x(\theta )}$ is implementable, so the designer can confine his search to a monotonic ${\displaystyle x(\theta )}$.

## Highlighted results

### Revenue equivalence theorem

Vickrey  ( 1961 ) gives a celebrated result that any member of a large class of auctions assures the seller of the same expected revenue and that the expected revenue is the best the seller can do. This is the case if

1. The buyers have identical valuation functions (which may be a function of type)
2. The buyers' types are independently distributed
3. The buyers types are drawn from a continuous distribution
4. The type distribution bears the monotone hazard rate property
5. The mechanism sells the good to the buyer with the highest valuation

The last condition is crucial to the theorem. An implication is that for the seller to achieve higher revenue he must take a chance on giving the item to an agent with a lower valuation. Usually this means he must risk not selling the item at all.

### Vickrey–Clarke–Groves mechanisms

The Vickrey (1961) auction model was later expanded by Clarke  ( 1971 ) and Groves to treat a public choice problem in which a public project's cost is borne by all agents, e.g. whether to build a municipal bridge. The resulting "Vickrey–Clarke–Groves" mechanism can motivate agents to choose the socially efficient allocation of the public good even if agents have privately known valuations. In other words, it can solve the "tragedy of the commons"—under certain conditions, in particular quasilinear utility or if budget balance is not required.

Consider a setting in which ${\displaystyle I}$ number of agents have quasilinear utility with private valuations ${\displaystyle v(x,t,\theta )}$ where the currency ${\displaystyle t}$ is valued linearly. The VCG designer designs an incentive compatible (hence truthfully implementable) mechanism to obtain the true type profile, from which the designer implements the socially optimal allocation

${\displaystyle x_{I}^{*}(\theta )\in {\underset {x\in X}{\operatorname {argmax} }}\sum _{i\in I}v(x,\theta _{i})}$

The cleverness of the VCG mechanism is the way it motivates truthful revelation. It eliminates incentives to misreport by penalizing any agent by the cost of the distortion he causes. Among the reports the agent may make, the VCG mechanism permits a "null" report saying he is indifferent to the public good and cares only about the money transfer. This effectively removes the agent from the game. If an agent does choose to report a type, the VCG mechanism charges the agent a fee if his report is pivotal, that is if his report changes the optimal allocation x so as to harm other agents. The payment is calculated

${\displaystyle t_{i}({\hat {\theta }})=\sum _{j\in I-i}v_{j}(x_{I-i}^{*}(\theta _{I-i}),\theta _{j})-\sum _{j\in I-i}v_{j}(x_{I}^{*}({\hat {\theta }}_{i},\theta _{I}),\theta _{j})}$

which sums the distortion in the utilities of the other agents (and not his own) caused by one agent reporting.

### Gibbard–Satterthwaite theorem

Gibbard  ( 1973 ) and Satterthwaite  ( 1975 ) give an impossibility result similar in spirit to Arrow's impossibility theorem. For a very general class of games, only "dictatorial" social choice functions can be implemented.

A social choice function f() is dictatorial if one agent always receives his most-favored goods allocation,

${\displaystyle {\text{for }}f(\Theta ){\text{, }}\exists i\in I{\text{ such that }}u_{i}(x,\theta _{i})\geq u_{i}(x',\theta _{i})\ \forall x'\in X}$

The theorem states that under general conditions any truthfully implementable social choice function must be dictatorial if,

1. X is finite and contains at least three elements
2. Preferences are rational
3. ${\displaystyle f(\Theta )=X}$

### Myerson–Satterthwaite theorem

Myerson andSatterthwaite ( 1983 ) show there is no efficient way for two parties to trade a good when they each have secret and probabilistically varying valuations for it, without the risk of forcing one party to trade at a loss. It is among the most remarkable negative results in economics—a kind of negative mirror to the fundamental theorems of welfare economics.

## Examples

### Price discrimination

Mirrlees  ( 1971 ) introduces a setting in which the transfer function t() is easy to solve for. Due to its relevance and tractability it is a common setting in the literature. Consider a single-good, single-agent setting in which the agent has quasilinear utility with an unknown type parameter ${\displaystyle \theta }$

${\displaystyle u(x,t,\theta )=V(x,\theta )-t}$

and in which the principal has a prior CDF over the agent's type ${\displaystyle P(\theta )}$. The principal can produce goods at a convex marginal cost c(x) and wants to maximize the expected profit from the transaction

${\displaystyle \max _{x(\theta ),t(\theta )}\mathbb {E} _{\theta }\left[t(\theta )-c\left(x(\theta )\right)\right]}$

subject to IC and IR conditions

${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq u(x(\theta '),t(\theta '),\theta )\ \forall \theta ,\theta '}$
${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq {\underline {u}}(\theta )\ \forall \theta }$

The principal here is a monopolist trying to set a profit-maximizing price scheme in which it cannot identify the type of the customer. A common example is an airline setting fares for business, leisure and student travelers. Due to the IR condition it has to give every type a good enough deal to induce participation. Due to the IC condition it has to give every type a good enough deal that the type prefers its deal to that of any other.

A trick given by Mirrlees (1971) is to use the envelope theorem to eliminate the transfer function from the expectation to be maximized,

${\displaystyle {\text{let }}U(\theta )=\max _{\theta '}u\left(x(\theta '),t(\theta '),\theta \right)}$
${\displaystyle {\frac {dU}{d\theta }}={\frac {\partial u}{\partial \theta }}={\frac {\partial V}{\partial \theta }}}$

Integrating,

${\displaystyle U(\theta )={\underline {u}}(\theta _{0})+\int _{\theta _{0}}^{\theta }{\frac {\partial V}{\partial {\tilde {\theta }}}}d{\tilde {\theta }}}$

where ${\displaystyle \theta _{0}}$ is some index type. Replacing the incentive-compatible ${\displaystyle t(\theta )=V(x(\theta ),\theta )-U(\theta )}$ in the maximand,

${\displaystyle \mathbb {E} _{\theta }\left[V(x(\theta ),\theta )-{\underline {u}}(\theta _{0})-\int _{\theta _{0}}^{\theta }{\frac {\partial V}{\partial {\tilde {\theta }}}}d{\tilde {\theta }}-c\left(x(\theta )\right)\right]}$
${\displaystyle =\mathbb {E} _{\theta }\left[V(x(\theta ),\theta )-{\underline {u}}(\theta _{0})-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial V}{\partial \theta }}-c\left(x(\theta )\right)\right]}$

after an integration by parts. This function can be maximized pointwise.

Because ${\displaystyle U(\theta )}$ is incentive-compatible already the designer can drop the IC constraint. If the utility function satisfies the Spence–Mirrlees condition then a monotonic ${\displaystyle x(\theta )}$ function exists. The IR constraint can be checked at equilibrium and the fee schedule raised or lowered accordingly. Additionally, note the presence of a hazard rate in the expression. If the type distribution bears the monotone hazard ratio property, the FOC is sufficient to solve for t(). If not, then it is necessary to check whether the monotonicity constraint (see sufficiency, above) is satisfied everywhere along the allocation and fee schedules. If not, then the designer must use Myerson ironing.

### Myerson ironing

In some applications the designer may solve the first-order conditions for the price and allocation schedules yet find they are not monotonic. For example, in the quasilinear setting this often happens when the hazard ratio is itself not monotone. By the Spence–Mirrlees condition the optimal price and allocation schedules must be monotonic, so the designer must eliminate any interval over which the schedule changes direction by flattening it.

Intuitively, what is going on is the designer finds it optimal to bunch certain types together and give them the same contract. Normally the designer motivates higher types to distinguish themselves by giving them a better deal. If there are insufficiently few higher types on the margin the designer does not find it worthwhile to grant lower types a concession (called their information rent) in order to charge higher types a type-specific contract.

Consider a monopolist principal selling to agents with quasilinear utility, the example above. Suppose the allocation schedule ${\displaystyle x(\theta )}$ satisfying the first-order conditions has a single interior peak at ${\displaystyle \theta _{1}}$ and a single interior trough at ${\displaystyle \theta _{2}>\theta _{1}}$, illustrated at right.

• Following Myerson (1981) flatten it by choosing ${\displaystyle x}$ satisfying
${\displaystyle \int _{\phi _{2}(x)}^{\phi _{1}(x)}\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)d\theta =0}$
where ${\displaystyle \phi _{1}(x)}$ is the inverse function of x mapping to ${\displaystyle \theta \leq \theta _{1}}$ and ${\displaystyle \phi _{2}(x)}$is the inverse function of x mapping to ${\displaystyle \theta \geq \theta _{2}}$. That is, ${\displaystyle \phi _{1}}$ returns a ${\displaystyle \theta }$ before the interior peak and ${\displaystyle \phi _{2}}$ returns a ${\displaystyle \theta }$ after the interior trough.
• If the nonmonotonic region of ${\displaystyle x(\theta )}$ borders the edge of the type space, simply set the appropriate ${\displaystyle \phi (x)}$ function (or both) to the boundary type. If there are multiple regions, see a textbook for an iterative procedure; it may be that more than one troughs should be ironed together.

#### Proof

The proof uses the theory of optimal control. It considers the set of intervals ${\displaystyle \left[{\underline {\theta }},{\overline {\theta }}\right]}$ in the nonmonotonic region of ${\displaystyle x(\theta )}$ over which it might flatten the schedule. It then writes a Hamiltonian to obtain necessary conditions for a ${\displaystyle x(\theta )}$ within the intervals

1. that does satisfy monotonicity
2. for which the monotonicity constraint is not binding on the boundaries of the interval

Condition two ensures that the ${\displaystyle x(\theta )}$ satisfying the optimal control problem reconnects to the schedule in the original problem at the interval boundaries (no jumps). Any ${\displaystyle x(\theta )}$ satisfying the necessary conditions must be flat because it must be monotonic and yet reconnect at the boundaries.

As before maximize the principal's expected payoff, but this time subject to the monotonicity constraint

${\displaystyle {\frac {\partial x}{\partial \theta }}\geq 0}$

and use a Hamiltonian to do it, with shadow price ${\displaystyle \nu (\theta )}$

${\displaystyle H=\left(V(x,\theta )-{\underline {u}}(\theta _{0})-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial V}{\partial \theta }}(x,\theta )-c(x)\right)p(\theta )+\nu (\theta ){\frac {\partial x}{\partial \theta }}}$

where ${\displaystyle x}$ is a state variable and ${\displaystyle \partial x/\partial \theta }$ the control. As usual in optimal control the costate evolution equation must satisfy

${\displaystyle {\frac {\partial \nu }{\partial \theta }}=-{\frac {\partial H}{\partial x}}=-\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)p(\theta )}$

Taking advantage of condition 2, note the monotonicity constraint is not binding at the boundaries of the ${\displaystyle \theta }$ interval,

${\displaystyle \nu ({\underline {\theta }})=\nu ({\overline {\theta }})=0}$

meaning the costate variable condition can be integrated and also equals 0

${\displaystyle \int _{\underline {\theta }}^{\overline {\theta }}\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)p(\theta )\,d\theta =0}$

The average distortion of the principal's surplus must be 0. To flatten the schedule, find an ${\displaystyle x}$ such that its inverse image maps to a ${\displaystyle \theta }$ interval satisfying the condition above.

## Notes

1. L. Hurwicz & S. Reiter (2006) Designing Economic Mechanisms, p. 30
2. "The Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel 2007" (Press release). Nobel Foundation. October 15, 2007. Retrieved 2008-08-15.
3. In unusual circumstances some truth-telling games have more equilibria than the Bayesian game they mapped from. See Fudenburg-Tirole Ch. 7.2 for some references.

## Related Research Articles

In mathematics, Laplace's equation is a second-order partial differential equation named after Pierre-Simon Laplace who first studied its properties. This is often written as

In statistics, the likelihood function measures the goodness of fit of a statistical model to a sample of data for given values of the unknown parameters. It is formed from the joint probability distribution of the sample, but viewed and used as a function of the parameters only, thus treating the random variables as fixed at the observed values.

In physics, the Navier–Stokes equations, named after Claude-Louis Navier and George Gabriel Stokes, describe the motion of viscous fluid substances.

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of a probability distribution by maximizing a likelihood function, so that under the assumed statistical model the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

In the mathematical field of differential geometry, a metric tensor is a type of function which takes as input a pair of tangent vectors v and w at a point of a surface and produces a real number scalar g(v, w) in a way that generalizes many of the familiar properties of the dot product of vectors in Euclidean space. In the same way as a dot product, metric tensors are used to define the length of and angle between tangent vectors. Through integration, the metric tensor allows one to define and compute the length of curves on the manifold.

In mathematics and physical science, spherical harmonics are special functions defined on the surface of a sphere. They are often employed in solving partial differential equations in many scientific fields. Since the spherical harmonics form a complete set of orthogonal functions and thus an orthonormal basis, each function defined on the surface of a sphere can be written as a sum of these spherical harmonics. This is similar to periodic functions defined on a circle that can be expressed as a sum of circular functions via Fourier series. Like the sines and cosines in Fourier series, the spherical harmonics may be organized by (spatial) angular frequency, as seen in the rows of functions in the illustration on the right. Further, spherical harmonics are basis functions for irreducible representations of SO(3), the group of rotations in three dimensions, and thus play a central role in the group theoretic discussion of SO(3).

In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family", or the older term Koopman–Darmois family. The terms "distribution" and "family" are often used loosely: properly, an exponential family is a set of distributions, where the specific distribution varies with the parameter; however, a parametric family of distributions is often referred to as "a distribution", and the set of all exponential families is sometimes loosely referred to as "the" exponential family.

In mathematics, the symmetry of second derivatives refers to the possibility under certain conditions of interchanging the order of taking partial derivatives of a function

In mathematical statistics, the Kullback–Leibler divergence is a measure of how one probability distribution is different from a second, reference probability distribution. Applications include characterizing the relative (Shannon) entropy in information systems, randomness in continuous time-series, and information gain when comparing statistical models of inference. In contrast to variation of information, it is a distribution-wise asymmetric measure and thus does not qualify as a statistical metric of spread - it also does not satisfy the triangle inequality. In the simple case, a Kullback–Leibler divergence of 0 indicates that the two distributions in question are identical. In simplified terms, it is a measure of surprise, with diverse applications such as applied statistics, fluid mechanics, neuroscience and machine learning.

In information geometry, the Fisher information metric is a particular Riemannian metric which can be defined on a smooth statistical manifold, i.e., a smooth manifold whose points are probability measures defined on a common probability space. It can be used to calculate the informational difference between measurements.

In estimation theory and statistics, the Cramér–Rao bound (CRB), Cramér–Rao lower bound (CRLB), Cramér–Rao inequality, Fréchet–Darmois–Cramér–Rao inequality, or information inequality expresses a lower bound on the variance of unbiased estimators of a deterministic parameter. This term is named in honor of Harald Cramér, Calyampudi Radhakrishna Rao, Maurice Fréchet and Georges Darmois all of whom independently derived this limit to statistical precision in the 1940s.

In mathematical statistics, the Fisher information is a way of measuring the amount of information that an observable random variable X carries about an unknown parameter θ of a distribution that models X. Formally, it is the variance of the score, or the expected value of the observed information. In Bayesian statistics, the asymptotic distribution of the posterior mode depends on the Fisher information and not on the prior. The role of the Fisher information in the asymptotic theory of maximum-likelihood estimation was emphasized by the statistician Ronald Fisher. The Fisher information is also used in the calculation of the Jeffreys prior, which is used in Bayesian statistics.

In mathematics, the eigenvalue problem for the laplace operator is called Helmholtz equation. It corresponds to the linear partial differential equation:

In statistics, M-estimators are a broad class of extremum estimators for which the objective function is a sample average. Both non-linear least squares and maximum likelihood estimation are special cases of M-estimators. The definition of M-estimators was motivated by robust statistics, which contributed new types of M-estimators. The statistical procedure of evaluating an M-estimator on a data set is called M-estimation.

In statistics, the monotone likelihood ratio property is a property of the ratio of two probability density functions (PDFs). Formally, distributions ƒ(x) and g(x) bear the property if

Frontogenesis is a meteorological process of tightening of horizontal temperature gradients to produce fronts. In the end, two types of fronts form: cold fronts and warm fronts. A cold front is a narrow line where temperature decreases rapidly. A warm front is a narrow line of warmer temperatures and essentially where much of the precipitation occurs. Frontogenesis occurs as a result of a developing baroclinic wave. According to Hoskins & Bretherton, there are eight mechanisms that influence temperature gradients: horizontal deformation, horizontal shearing, vertical deformation, differential vertical motion, latent heat release, surface friction, turbulence and mixing, and radiation. Semigeostrophic frontogenesis theory focuses on the role of horizontal deformation and shear.

In fluid dynamics, the Oseen equations describe the flow of a viscous and incompressible fluid at small Reynolds numbers, as formulated by Carl Wilhelm Oseen in 1910. Oseen flow is an improved description of these flows, as compared to Stokes flow, with the (partial) inclusion of convective acceleration.

Although the term well-behaved statistic often seems to be used in the scientific literature in somewhat the same way as is well-behaved in mathematics, that is, to mean 'non-pathological' it can also be assigned precise mathematical meaning, and in more than one way. In the former case, the meaning of this term will vary from context to context. In the latter case, the mathematical conditions can be used to derive classes of combinations of distributions with statistics which are well-behaved in each sense.

In statistics, the variance function is a smooth function which depicts the variance of a random quantity as a function of its mean. The variance function plays a large role in many settings of statistical modelling. It is a main ingredient in the generalized linear model framework and a tool used in non-parametric regression, semiparametric regression and functional data analysis. In parametric modeling, variance functions take on a parametric form and explicitly describe the relationship between the variance and the mean of a random quantity. In a non-parametric setting, the variance function is assumed to be a smooth function.