# Mechanism design

Last updated

Mechanism design is a field in economics and game theory that takes an objectives-first approach to designing economic mechanisms or incentives, toward desired objectives, in strategic settings, where players act rationally. Because it starts at the end of the game, then goes backwards, it is also called reverse game theory. It has broad applications, from economics and politics in such fields as market design, auction theory and social choice theory to networked-systems (internet interdomain routing, sponsored search auctions).

## Contents

Mechanism design studies solution concepts for a class of private-information games. Leonid Hurwicz explains that 'in a design problem, the goal function is the main "given", while the mechanism is the unknown. Therefore, the design problem is the "inverse" of traditional economic theory, which is typically devoted to the analysis of the performance of a given mechanism.' [1] So, two distinguishing features of these games are:

• that a game "designer" chooses the game structure rather than inheriting one
• that the designer is interested in the game's outcome

The 2007 Nobel Memorial Prize in Economic Sciences was awarded to Leonid Hurwicz, Eric Maskin, and Roger Myerson "for having laid the foundations of mechanism design theory". [2]

## Intuition

In an interesting class of Bayesian games, one player, called the "principal", would like to condition his behavior on information privately known to other players. For example, the principal would like to know the true quality of a used car a salesman is pitching. He cannot learn anything simply by asking the salesman, because it is in the salesman's interest to distort the truth. However, in mechanism design the principal does have one advantage: He may design a game whose rules can influence others to act the way he would like.

Without mechanism design theory, the principal's problem would be difficult to solve. He would have to consider all the possible games and choose the one that best influences other players' tactics. In addition, the principal would have to draw conclusions from agents who may lie to him. Thanks to mechanism design, and particularly the revelation principle, the principal only needs to consider games in which agents truthfully report their private information.

## Foundations

### Mechanism

A game of mechanism design is a game of private information in which one of the agents, called the principal, chooses the payoff structure. Following Harsanyi  ( 1967 ), the agents receive secret "messages" from nature containing information relevant to payoffs. For example, a message may contain information about their preferences or the quality of a good for sale. We call this information the agent's "type" (usually noted ${\displaystyle \theta }$ and accordingly the space of types ${\displaystyle \Theta }$). Agents then report a type to the principal (usually noted with a hat ${\displaystyle {\hat {\theta }}}$) that can be a strategic lie. After the report, the principal and the agents are paid according to the payoff structure the principal chose.

The timing of the game is:

1. The principal commits to a mechanism ${\displaystyle y()}$ that grants an outcome ${\displaystyle y}$ as a function of reported type
2. The agents report, possibly dishonestly, a type profile ${\displaystyle {\hat {\theta }}}$
3. The mechanism is executed (agents receive outcome ${\displaystyle y({\hat {\theta }})}$)

In order to understand who gets what, it is common to divide the outcome ${\displaystyle y}$ into a goods allocation and a money transfer, ${\displaystyle y(\theta )=\{x(\theta ),t(\theta )\},\ x\in X,t\in T}$ where ${\displaystyle x}$ stands for an allocation of goods rendered or received as a function of type, and ${\displaystyle t}$ stands for a monetary transfer as a function of type.

As a benchmark the designer often defines what would happen under full information. Define a social choice function${\displaystyle f(\theta )}$ mapping the (true) type profile directly to the allocation of goods received or rendered,

${\displaystyle f(\theta ):\Theta \rightarrow X}$

In contrast a mechanism maps the reported type profile to an outcome (again, both a goods allocation ${\displaystyle x}$ and a money transfer ${\displaystyle t}$)

${\displaystyle y({\hat {\theta }}):\Theta \rightarrow Y}$

### Revelation principle

A proposed mechanism constitutes a Bayesian game (a game of private information), and if it is well-behaved the game has a Bayesian Nash equilibrium. At equilibrium agents choose their reports strategically as a function of type

${\displaystyle {\hat {\theta }}(\theta )}$

It is difficult to solve for Bayesian equilibria in such a setting because it involves solving for agents' best-response strategies and for the best inference from a possible strategic lie. Thanks to a sweeping result called the revelation principle, no matter the mechanism a designer can [3] confine attention to equilibria in which agents truthfully report type. The revelation principle states: "To every Bayesian Nash equilibrium there corresponds a Bayesian game with the same equilibrium outcome but in which players truthfully report type."

This is extremely useful. The principle allows one to solve for a Bayesian equilibrium by assuming all players truthfully report type (subject to an incentive compatibility constraint). In one blow it eliminates the need to consider either strategic behavior or lying.

Its proof is quite direct. Assume a Bayesian game in which the agent's strategy and payoff are functions of its type and what others do, ${\displaystyle u_{i}\left(s_{i}(\theta _{i}),s_{-i}(\theta _{-i}),\theta _{i}\right)}$. By definition agent i's equilibrium strategy ${\displaystyle s(\theta _{i})}$ is Nash in expected utility:

${\displaystyle s_{i}(\theta _{i})\in \arg \max _{s'_{i}\in S_{i}}\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(s'_{i},s_{-i}(\theta _{-i}),\theta _{i}\right)}$

Simply define a mechanism that would induce agents to choose the same equilibrium. The easiest one to define is for the mechanism to commit to playing the agents' equilibrium strategies for them.

${\displaystyle y({\hat {\theta }}):\Theta \rightarrow S(\Theta )\rightarrow Y}$

Under such a mechanism the agents of course find it optimal to reveal type since the mechanism plays the strategies they found optimal anyway. Formally, choose ${\displaystyle y(\theta )}$ such that

{\displaystyle {\begin{aligned}\theta _{i}\in {}&\arg \max _{\theta '_{i}\in \Theta }\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(y(\theta '_{i},\theta _{-i}),\theta _{i}\right)\\[5pt]&=\sum _{\theta _{-i}}\ p(\theta _{-i}\mid \theta _{i})\ u_{i}\left(s_{i}(\theta ),s_{-i}(\theta _{-i}),\theta _{i}\right)\end{aligned}}}

### Implementability

The designer of a mechanism generally hopes either

• to design a mechanism ${\displaystyle y()}$ that "implements" a social choice function
• to find the mechanism ${\displaystyle y()}$ that maximizes some value criterion (e.g. profit)

To implement a social choice function ${\displaystyle f(\theta )}$ is to find some ${\displaystyle t(\theta )}$ transfer function that motivates agents to pick ${\displaystyle f(\theta )}$. Formally, if the equilibrium strategy profile under the mechanism maps to the same goods allocation as a social choice function,

${\displaystyle f(\theta )=x\left({\hat {\theta }}(\theta )\right)}$

we say the mechanism implements the social choice function.

Thanks to the revelation principle, the designer can usually find a transfer function ${\displaystyle t(\theta )}$ to implement a social choice by solving an associated truthtelling game. If agents find it optimal to truthfully report type,

${\displaystyle {\hat {\theta }}(\theta )=\theta }$

we say such a mechanism is truthfully implementable (or just "implementable"). The task is then to solve for a truthfully implementable ${\displaystyle t(\theta )}$ and impute this transfer function to the original game. An allocation ${\displaystyle x(\theta )}$ is truthfully implementable if there exists a transfer function ${\displaystyle t(\theta )}$ such that

${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq u(x({\hat {\theta }}),t({\hat {\theta }}),\theta )\ \forall \theta ,{\hat {\theta }}\in \Theta }$

which is also called the incentive compatibility (IC) constraint.

In applications, the IC condition is the key to describing the shape of ${\displaystyle t(\theta )}$ in any useful way. Under certain conditions it can even isolate the transfer function analytically. Additionally, a participation (individual rationality) constraint is sometimes added if agents have the option of not playing.

#### Necessity

Consider a setting in which all agents have a type-contingent utility function ${\displaystyle u(x,t,\theta )}$. Consider also a goods allocation ${\displaystyle x(\theta )}$ that is vector-valued and size ${\displaystyle k}$ (which permits ${\displaystyle k}$ number of goods) and assume it is piecewise continuous with respect to its arguments.

The function ${\displaystyle x(\theta )}$ is implementable only if

${\displaystyle \sum _{k=1}^{n}{\frac {\partial }{\partial \theta }}\left({\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}\right){\frac {\partial x}{\partial \theta }}\geq 0}$

whenever ${\displaystyle x=x(\theta )}$ and ${\displaystyle t=t(\theta )}$ and x is continuous at ${\displaystyle \theta }$. This is a necessary condition and is derived from the first- and second-order conditions of the agent's optimization problem assuming truth-telling.

Its meaning can be understood in two pieces. The first piece says the agent's marginal rate of substitution (MRS) increases as a function of the type,

${\displaystyle {\frac {\partial }{\partial \theta }}\left({\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}\right)={\frac {\partial }{\partial \theta }}\mathrm {MRS} _{x,t}}$

In short, agents will not tell the truth if the mechanism does not offer higher agent types a better deal. Otherwise, higher types facing any mechanism that punishes high types for reporting will lie and declare they are lower types, violating the truthtelling IC constraint. The second piece is a monotonicity condition waiting to happen,

${\displaystyle {\frac {\partial x}{\partial \theta }}}$

which, to be positive, means higher types must be given more of the good.

There is potential for the two pieces to interact. If for some type range the contract offered less quantity to higher types ${\displaystyle \partial x/\partial \theta <0}$, it is possible the mechanism could compensate by giving higher types a discount. But such a contract already exists for low-type agents, so this solution is pathological. Such a solution sometimes occurs in the process of solving for a mechanism. In these cases it must be "ironed." In a multiple-good environment it is also possible for the designer to reward the agent with more of one good to substitute for less of another (e.g. butter for margarine). Multiple-good mechanisms are an ongoing problem in mechanism design theory.

#### Sufficiency

Mechanism design papers usually make two assumptions to ensure implementability:

1. ${\displaystyle {\frac {\partial }{\partial \theta }}{\frac {\partial u/\partial x_{k}}{\left|\partial u/\partial t\right|}}>0\ \forall k}$

This is known by several names: the single-crossing condition, the sorting condition and the Spence–Mirrlees condition. It means the utility function is of such a shape that the agent's MRS is increasing in type.

1. ${\displaystyle \exists K_{0},K_{1}{\text{ such that }}\left|{\frac {\partial u/\partial x_{k}}{\partial u/\partial t}}\right|\leq K_{0}+K_{1}|t|}$

This is a technical condition bounding the rate of growth of the MRS.

These assumptions are sufficient to provide that any monotonic ${\displaystyle x(\theta )}$ is implementable (a ${\displaystyle t(\theta )}$ exists that can implement it). In addition, in the single-good setting the single-crossing condition is sufficient to provide that only a monotonic ${\displaystyle x(\theta )}$ is implementable, so the designer can confine his search to a monotonic ${\displaystyle x(\theta )}$.

## Highlighted results

### Revenue equivalence theorem

Vickrey  ( 1961 ) gives a celebrated result that any member of a large class of auctions assures the seller of the same expected revenue and that the expected revenue is the best the seller can do. This is the case if

1. The buyers have identical valuation functions (which may be a function of type)
2. The buyers' types are independently distributed
3. The buyers types are drawn from a continuous distribution
4. The type distribution bears the monotone hazard rate property
5. The mechanism sells the good to the buyer with the highest valuation

The last condition is crucial to the theorem. An implication is that for the seller to achieve higher revenue he must take a chance on giving the item to an agent with a lower valuation. Usually this means he must risk not selling the item at all.

### Vickrey–Clarke–Groves mechanisms

The Vickrey (1961) auction model was later expanded by Clarke  ( 1971 ) and Groves to treat a public choice problem in which a public project's cost is borne by all agents, e.g. whether to build a municipal bridge. The resulting "Vickrey–Clarke–Groves" mechanism can motivate agents to choose the socially efficient allocation of the public good even if agents have privately known valuations. In other words, it can solve the "tragedy of the commons"—under certain conditions, in particular quasilinear utility or if budget balance is not required.

Consider a setting in which ${\displaystyle I}$ number of agents have quasilinear utility with private valuations ${\displaystyle v(x,t,\theta )}$ where the currency ${\displaystyle t}$ is valued linearly. The VCG designer designs an incentive compatible (hence truthfully implementable) mechanism to obtain the true type profile, from which the designer implements the socially optimal allocation

${\displaystyle x_{I}^{*}(\theta )\in {\underset {x\in X}{\operatorname {argmax} }}\sum _{i\in I}v(x,\theta _{i})}$

The cleverness of the VCG mechanism is the way it motivates truthful revelation. It eliminates incentives to misreport by penalizing any agent by the cost of the distortion he causes. Among the reports the agent may make, the VCG mechanism permits a "null" report saying he is indifferent to the public good and cares only about the money transfer. This effectively removes the agent from the game. If an agent does choose to report a type, the VCG mechanism charges the agent a fee if his report is pivotal, that is if his report changes the optimal allocation x so as to harm other agents. The payment is calculated

${\displaystyle t_{i}({\hat {\theta }})=\sum _{j\in I-i}v_{j}(x_{I-i}^{*}(\theta _{I-i}),\theta _{j})-\sum _{j\in I-i}v_{j}(x_{I}^{*}({\hat {\theta }}_{i},\theta _{I}),\theta _{j})}$

which sums the distortion in the utilities of the other agents (and not his own) caused by one agent reporting.

### Gibbard–Satterthwaite theorem

Gibbard  ( 1973 ) and Satterthwaite  ( 1975 ) give an impossibility result similar in spirit to Arrow's impossibility theorem. For a very general class of games, only "dictatorial" social choice functions can be implemented.

A social choice function f() is dictatorial if one agent always receives his most-favored goods allocation,

${\displaystyle {\text{for }}f(\Theta ){\text{, }}\exists i\in I{\text{ such that }}u_{i}(x,\theta _{i})\geq u_{i}(x',\theta _{i})\ \forall x'\in X}$

The theorem states that under general conditions any truthfully implementable social choice function must be dictatorial if,

1. X is finite and contains at least three elements
2. Preferences are rational
3. ${\displaystyle f(\Theta )=X}$

### Myerson–Satterthwaite theorem

Myerson andSatterthwaite ( 1983 ) show there is no efficient way for two parties to trade a good when they each have secret and probabilistically varying valuations for it, without the risk of forcing one party to trade at a loss. It is among the most remarkable negative results in economics—a kind of negative mirror to the fundamental theorems of welfare economics.

### Shapley value

Phillips and Marden (2018) proved that for cost-sharing games with concave cost functions, the optimal cost-sharing rule that firstly optimizes the worst-case inefficiencies in a game (the price of anarchy), and then secondly optimizes the best-case outcomes (the price of stability), is precisely the Shapley value cost-sharing rule. [4] A symmetrical statement is similarly valid for utility-sharing games with convex utility functions.

## Examples

### Price discrimination

Mirrlees  ( 1971 ) introduces a setting in which the transfer function t() is easy to solve for. Due to its relevance and tractability it is a common setting in the literature. Consider a single-good, single-agent setting in which the agent has quasilinear utility with an unknown type parameter ${\displaystyle \theta }$

${\displaystyle u(x,t,\theta )=V(x,\theta )-t}$

and in which the principal has a prior CDF over the agent's type ${\displaystyle P(\theta )}$. The principal can produce goods at a convex marginal cost c(x) and wants to maximize the expected profit from the transaction

${\displaystyle \max _{x(\theta ),t(\theta )}\mathbb {E} _{\theta }\left[t(\theta )-c\left(x(\theta )\right)\right]}$

subject to IC and IR conditions

${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq u(x(\theta '),t(\theta '),\theta )\ \forall \theta ,\theta '}$
${\displaystyle u(x(\theta ),t(\theta ),\theta )\geq {\underline {u}}(\theta )\ \forall \theta }$

The principal here is a monopolist trying to set a profit-maximizing price scheme in which it cannot identify the type of the customer. A common example is an airline setting fares for business, leisure and student travelers. Due to the IR condition it has to give every type a good enough deal to induce participation. Due to the IC condition it has to give every type a good enough deal that the type prefers its deal to that of any other.

A trick given by Mirrlees (1971) is to use the envelope theorem to eliminate the transfer function from the expectation to be maximized,

${\displaystyle {\text{let }}U(\theta )=\max _{\theta '}u\left(x(\theta '),t(\theta '),\theta \right)}$
${\displaystyle {\frac {dU}{d\theta }}={\frac {\partial u}{\partial \theta }}={\frac {\partial V}{\partial \theta }}}$

Integrating,

${\displaystyle U(\theta )={\underline {u}}(\theta _{0})+\int _{\theta _{0}}^{\theta }{\frac {\partial V}{\partial {\tilde {\theta }}}}d{\tilde {\theta }}}$

where ${\displaystyle \theta _{0}}$ is some index type. Replacing the incentive-compatible ${\displaystyle t(\theta )=V(x(\theta ),\theta )-U(\theta )}$ in the maximand,

{\displaystyle {\begin{aligned}&\mathbb {E} _{\theta }\left[V(x(\theta ),\theta )-{\underline {u}}(\theta _{0})-\int _{\theta _{0}}^{\theta }{\frac {\partial V}{\partial {\tilde {\theta }}}}d{\tilde {\theta }}-c\left(x(\theta )\right)\right]\\&{}=\mathbb {E} _{\theta }\left[V(x(\theta ),\theta )-{\underline {u}}(\theta _{0})-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial V}{\partial \theta }}-c\left(x(\theta )\right)\right]\end{aligned}}}

after an integration by parts. This function can be maximized pointwise.

Because ${\displaystyle U(\theta )}$ is incentive-compatible already the designer can drop the IC constraint. If the utility function satisfies the Spence–Mirrlees condition then a monotonic ${\displaystyle x(\theta )}$ function exists. The IR constraint can be checked at equilibrium and the fee schedule raised or lowered accordingly. Additionally, note the presence of a hazard rate in the expression. If the type distribution bears the monotone hazard ratio property, the FOC is sufficient to solve for t(). If not, then it is necessary to check whether the monotonicity constraint (see sufficiency, above) is satisfied everywhere along the allocation and fee schedules. If not, then the designer must use Myerson ironing.

### Myerson ironing

In some applications the designer may solve the first-order conditions for the price and allocation schedules yet find they are not monotonic. For example, in the quasilinear setting this often happens when the hazard ratio is itself not monotone. By the Spence–Mirrlees condition the optimal price and allocation schedules must be monotonic, so the designer must eliminate any interval over which the schedule changes direction by flattening it.

Intuitively, what is going on is the designer finds it optimal to bunch certain types together and give them the same contract. Normally the designer motivates higher types to distinguish themselves by giving them a better deal. If there are insufficiently few higher types on the margin the designer does not find it worthwhile to grant lower types a concession (called their information rent) in order to charge higher types a type-specific contract.

Consider a monopolist principal selling to agents with quasilinear utility, the example above. Suppose the allocation schedule ${\displaystyle x(\theta )}$ satisfying the first-order conditions has a single interior peak at ${\displaystyle \theta _{1}}$ and a single interior trough at ${\displaystyle \theta _{2}>\theta _{1}}$, illustrated at right.

• Following Myerson (1981) flatten it by choosing ${\displaystyle x}$ satisfying
${\displaystyle \int _{\phi _{2}(x)}^{\phi _{1}(x)}\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)d\theta =0}$
where ${\displaystyle \phi _{1}(x)}$ is the inverse function of x mapping to ${\displaystyle \theta \leq \theta _{1}}$ and ${\displaystyle \phi _{2}(x)}$is the inverse function of x mapping to ${\displaystyle \theta \geq \theta _{2}}$. That is, ${\displaystyle \phi _{1}}$ returns a ${\displaystyle \theta }$ before the interior peak and ${\displaystyle \phi _{2}}$ returns a ${\displaystyle \theta }$ after the interior trough.
• If the nonmonotonic region of ${\displaystyle x(\theta )}$ borders the edge of the type space, simply set the appropriate ${\displaystyle \phi (x)}$ function (or both) to the boundary type. If there are multiple regions, see a textbook for an iterative procedure; it may be that more than one troughs should be ironed together.

#### Proof

The proof uses the theory of optimal control. It considers the set of intervals ${\displaystyle \left[{\underline {\theta }},{\overline {\theta }}\right]}$ in the nonmonotonic region of ${\displaystyle x(\theta )}$ over which it might flatten the schedule. It then writes a Hamiltonian to obtain necessary conditions for a ${\displaystyle x(\theta )}$ within the intervals

1. that does satisfy monotonicity
2. for which the monotonicity constraint is not binding on the boundaries of the interval

Condition two ensures that the ${\displaystyle x(\theta )}$ satisfying the optimal control problem reconnects to the schedule in the original problem at the interval boundaries (no jumps). Any ${\displaystyle x(\theta )}$ satisfying the necessary conditions must be flat because it must be monotonic and yet reconnect at the boundaries.

As before maximize the principal's expected payoff, but this time subject to the monotonicity constraint

${\displaystyle {\frac {\partial x}{\partial \theta }}\geq 0}$

and use a Hamiltonian to do it, with shadow price ${\displaystyle \nu (\theta )}$

${\displaystyle H=\left(V(x,\theta )-{\underline {u}}(\theta _{0})-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial V}{\partial \theta }}(x,\theta )-c(x)\right)p(\theta )+\nu (\theta ){\frac {\partial x}{\partial \theta }}}$

where ${\displaystyle x}$ is a state variable and ${\displaystyle \partial x/\partial \theta }$ the control. As usual in optimal control the costate evolution equation must satisfy

${\displaystyle {\frac {\partial \nu }{\partial \theta }}=-{\frac {\partial H}{\partial x}}=-\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)p(\theta )}$

Taking advantage of condition 2, note the monotonicity constraint is not binding at the boundaries of the ${\displaystyle \theta }$ interval,

${\displaystyle \nu ({\underline {\theta }})=\nu ({\overline {\theta }})=0}$

meaning the costate variable condition can be integrated and also equals 0

${\displaystyle \int _{\underline {\theta }}^{\overline {\theta }}\left({\frac {\partial V}{\partial x}}(x,\theta )-{\frac {1-P(\theta )}{p(\theta )}}{\frac {\partial ^{2}V}{\partial \theta \,\partial x}}(x,\theta )-{\frac {\partial c}{\partial x}}(x)\right)p(\theta )\,d\theta =0}$

The average distortion of the principal's surplus must be 0. To flatten the schedule, find an ${\displaystyle x}$ such that its inverse image maps to a ${\displaystyle \theta }$ interval satisfying the condition above.

## Notes

1. L. Hurwicz & S. Reiter (2006) Designing Economic Mechanisms, p. 30
2. "The Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel 2007" (Press release). Nobel Foundation. October 15, 2007. Retrieved 2008-08-15.
3. In unusual circumstances some truth-telling games have more equilibria than the Bayesian game they mapped from. See Fudenburg-Tirole Ch. 7.2 for some references.
4. Phillips, Matthew; Marden, Jason R. (July 2018). "Design Tradeoffs in Concave Cost-Sharing Games". IEEE Transactions on Automatic Control. 63 (7): 2242–2247. doi:10.1109/tac.2017.2765299. ISSN   0018-9286. S2CID   45923961.

## Related Research Articles

In mathematics and physics, Laplace's equation is a second-order partial differential equation named after Pierre-Simon Laplace, who first studied its properties. This is often written as

The likelihood function describes the joint probability of the observed data as a function of the parameters of the chosen statistical model. For each specific parameter value in the parameter space, the likelihood function therefore assigns a probabilistic prediction to the observed data . Since it is essentially the product of sampling densities, the likelihood generally encapsulates both the data-generating process as well as the missing-data mechanism that produced the observed sample.

In physics, the Navier–Stokes equations are certain partial differential equations which describe the motion of viscous fluid substances, named after French engineer and physicist Claude-Louis Navier and Anglo-Irish physicist and mathematician George Gabriel Stokes. They were developed over several decades of progressively building the theories, from 1822 (Navier) to 1842–1850 (Stokes).

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

In statistics, a statistic is sufficient with respect to a statistical model and its associated unknown parameter if "no other statistic that can be calculated from the same sample provides any additional information as to the value of the parameter". In particular, a statistic is sufficient for a family of probability distributions if the sample from which it is calculated gives no additional information than the statistic, as to which of those probability distributions is the sampling distribution.

In mathematics and physical science, spherical harmonics are special functions defined on the surface of a sphere. They are often employed in solving partial differential equations in many scientific fields.

Linear elasticity is a mathematical model of how solid objects deform and become internally stressed due to prescribed loading conditions. It is a simplification of the more general nonlinear theory of elasticity and a branch of continuum mechanics.

In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family", or the older term Koopman–Darmois family. The terms "distribution" and "family" are often used loosely: specifically, an exponential family is a set of distributions, where the specific distribution varies with the parameter; however, a parametric family of distributions is often referred to as "a distribution", and the set of all exponential families is sometimes loosely referred to as "the" exponential family. They are distinct because they possess a variety of desirable properties, most importantly the existence of a sufficient statistic.

In mathematics, the symmetry of second derivatives refers to the possibility of interchanging the order of taking partial derivatives of a function

In information geometry, the Fisher information metric is a particular Riemannian metric which can be defined on a smooth statistical manifold, i.e., a smooth manifold whose points are probability measures defined on a common probability space. It can be used to calculate the informational difference between measurements.

In statistics, Gibbs sampling or a Gibbs sampler is a Markov chain Monte Carlo (MCMC) algorithm for obtaining a sequence of observations which are approximated from a specified multivariate probability distribution, when direct sampling is difficult. This sequence can be used to approximate the joint distribution ; to approximate the marginal distribution of one of the variables, or some subset of the variables ; or to compute an integral. Typically, some of the variables correspond to observations whose values are known, and hence do not need to be sampled.

In estimation theory and statistics, the Cramér–Rao bound (CRB) expresses a lower bound on the variance of unbiased estimators of a deterministic parameter, the variance of any such estimator is at least as high as the inverse of the Fisher information. Equivalently, it expresses an upper bound on the precision of unbiased estimators: the precision of any such estimator is at most the Fisher information. The result is named in honor of Harald Cramér and C. R. Rao, but has independently also been derived by Maurice Fréchet, Georges Darmois, as well as Alexander Aitken and Harold Silverstone.

In mathematical statistics, the Fisher information is a way of measuring the amount of information that an observable random variable X carries about an unknown parameter θ of a distribution that models X. Formally, it is the variance of the score, or the expected value of the observed information.

In mathematical statistics, the Kullback–Leibler divergence, denoted , is a type of statistical distance: a measure of how one probability distribution P is different from a second, reference probability distribution Q. A simple interpretation of the KL divergence of P from Q is the expected excess surprise from using Q as a model when the actual distribution is P. While it is a distance, it is not a metric, the most familiar type of distance: it is not symmetric in the two distributions, and does not satisfy the triangle inequality. Instead, in terms of information geometry, it is a type of divergence, a generalization of squared distance, and for certain classes of distributions, it satisfies a generalized Pythagorean theorem.

In mathematics, the eigenvalue problem for the Laplace operator is known as the Helmholtz equation. It corresponds to the linear partial differential equation

In statistics, M-estimators are a broad class of extremum estimators for which the objective function is a sample average. Both non-linear least squares and maximum likelihood estimation are special cases of M-estimators. The definition of M-estimators was motivated by robust statistics, which contributed new types of M-estimators. The statistical procedure of evaluating an M-estimator on a data set is called M-estimation. 48 samples of robust M-estimators can be found in a recent review study.

In differential geometry, the notion of torsion is a manner of characterizing a twist or screw of a moving frame around a curve. The torsion of a curve, as it appears in the Frenet–Serret formulas, for instance, quantifies the twist of a curve about its tangent vector as the curve evolves. In the geometry of surfaces, the geodesic torsion describes how a surface twists about a curve on the surface. The companion notion of curvature measures how moving frames "roll" along a curve "without twisting".

In statistics, the monotone likelihood ratio property is a property of the ratio of two probability density functions (PDFs). Formally, distributions ƒ(x) and g(x) bear the property if

Frontogenesis is a meteorological process of tightening of horizontal temperature gradients to produce fronts. In the end, two types of fronts form: cold fronts and warm fronts. A cold front is a narrow line where temperature decreases rapidly. A warm front is a narrow line of warmer temperatures and essentially where much of the precipitation occurs. Frontogenesis occurs as a result of a developing baroclinic wave. According to Hoskins & Bretherton, there are eight mechanisms that influence temperature gradients: horizontal deformation, horizontal shearing, vertical deformation, differential vertical motion, latent heat release, surface friction, turbulence and mixing, and radiation. Semigeostrophic frontogenesis theory focuses on the role of horizontal deformation and shear.

In fluid dynamics, the Oseen equations describe the flow of a viscous and incompressible fluid at small Reynolds numbers, as formulated by Carl Wilhelm Oseen in 1910. Oseen flow is an improved description of these flows, as compared to Stokes flow, with the (partial) inclusion of convective acceleration.