Maxima and minima

Last updated

In mathematical analysis, the maxima and minima (the respective plurals of maximum and minimum) of a function, known collectively as extrema (the plural of extremum), are the largest and smallest value of the function, either within a given range (the local or relative extrema), or on the entire domain (the global or absolute extrema). [1] [2] [3] Pierre de Fermat was one of the first mathematicians to propose a general technique, adequality, for finding the maxima and minima of functions.

Contents

As defined in set theory, the maximum and minimum of a set are the greatest and least elements in the set, respectively. Unbounded infinite sets, such as the set of real numbers, have no minimum or maximum.

Definition

A real-valued function f defined on a domain X has a global (or absolute) maximum point at x, if f(x) ≥ f(x) for all x in X. Similarly, the function has a global (or absolute) minimum point at x, if f(x) ≤ f(x) for all x in X. The value of the function at a maximum point is called the maximum value of the function, denoted ${\displaystyle \max(f(x))}$, [4] and the value of the function at a minimum point is called the minimum value of the function. Symbolically, this can be written as follows:

${\displaystyle x_{0}\in X}$ is a global maximum point of function ${\displaystyle f:X\to \mathbb {R} ,}$ if ${\displaystyle (\forall x\in X)\,f(x_{0})\geq f(x).}$

The definition of global minimum point also proceeds similarly.

If the domain X is a metric space, then f is said to have a local (or relative) maximum point at the point x, if there exists some ε > 0 such that f(x) ≥ f(x) for all x in X within distance ε of x. Similarly, the function has a local minimum point at x, if f(x) ≤ f(x) for all x in X within distance ε of x. A similar definition can be used when X is a topological space, since the definition just given can be rephrased in terms of neighbourhoods. Mathematically, the given definition is written as follows:

Let ${\displaystyle (X,d_{X})}$ be a metric space and function ${\displaystyle f:X\to \mathbb {R} }$. Then ${\displaystyle x_{0}\in X}$ is a local maximum point of function ${\displaystyle f}$ if ${\displaystyle (\exists \varepsilon >0)}$ such that ${\displaystyle (\forall x\in X)\,d_{X}(x,x_{0})<\varepsilon \implies f(x_{0})\geq f(x).}$

The definition of local minimum point can also proceed similarly.

In both the global and local cases, the concept of a strict extremum can be defined. For example, x is a strict global maximum point if for all x in X with xx, we have f(x) > f(x), and x is a strict local maximum point if there exists some ε > 0 such that, for all x in X within distance ε of x with xx, we have f(x) > f(x). Note that a point is a strict global maximum point if and only if it is the unique global maximum point, and similarly for minimum points.

A continuous real-valued function with a compact domain always has a maximum point and a minimum point. An important example is a function whose domain is a closed and bounded interval of real numbers (see the graph above).

Finding global maxima and minima is the goal of mathematical optimization. If a function is continuous on a closed interval, then by the extreme value theorem, global maxima and minima exist. Furthermore, a global maximum (or minimum) either must be a local maximum (or minimum) in the interior of the domain, or must lie on the boundary of the domain. So a method of finding a global maximum (or minimum) is to look at all the local maxima (or minima) in the interior, and also look at the maxima (or minima) of the points on the boundary, and take the largest (or smallest) one.

Likely the most important, yet quite obvious, feature of continuous real-valued functions of a real variable is that they decrease before local minima and increase afterwards, likewise for maxima. (Formally, if f is continuous real-valued function of a real variable x, then x0 is a local minimum if and only if there exist a < x0 < b such that f decreases on (a, x0) and increases on (x0, b)) [5] A direct consequence of this is the Fermat's theorem, which states that local extrema must occur at critical points (or points where the function is non-differentiable). [6] One can distinguish whether a critical point is a local maximum or local minimum by using the first derivative test, second derivative test, or higher-order derivative test, given sufficient differentiability. [7]

For any function that is defined piecewise, one finds a maximum (or minimum) by finding the maximum (or minimum) of each piece separately, and then seeing which one is largest (or smallest).

Examples

FunctionMaxima and minima
x2Unique global minimum at x = 0.
x3No global minima or maxima. Although the first derivative (3x2) is 0 at x = 0, this is an inflection point. (2nd derivative is 0 at that point.)
${\displaystyle {\sqrt[{x}]{x}}}$Unique global maximum at x = e . (See figure at right)
xxUnique global maximum over the positive real numbers at x = 1/e.
x3/3 − xFirst derivative x2 − 1 and second derivative 2x. Setting the first derivative to 0 and solving for x gives stationary points at −1 and +1. From the sign of the second derivative, we can see that −1 is a local maximum and +1 is a local minimum. This function has no global maximum or minimum.
|x|Global minimum at x = 0 that cannot be found by taking derivatives, because the derivative does not exist at x = 0.
cos(x)Infinitely many global maxima at 0, ±2π, ±4π, ..., and infinitely many global minima at ±π, ±3π, ±5π, ....
2 cos(x) − xInfinitely many local maxima and minima, but no global maximum or minimum.
cos(3πx)/x with 0.1 ≤ x ≤ 1.1Global maximum at x = 0.1 (a boundary), a global minimum near x = 0.3, a local maximum near x = 0.6, and a local minimum near x = 1.0. (See figure at top of page.)
x3 + 3x2 − 2x + 1 defined over the closed interval (segment) [−4,2]Local maximum at x = −1−15/3, local minimum at x = −1+15/3, global maximum at x = 2 and global minimum at x = −4.

For a practical example, [8] assume a situation where someone has ${\displaystyle 200}$ feet of fencing and is trying to maximize the square footage of a rectangular enclosure, where ${\displaystyle x}$ is the length, ${\displaystyle y}$ is the width, and ${\displaystyle xy}$ is the area:

${\displaystyle 2x+2y=200}$
${\displaystyle 2y=200-2x}$
${\displaystyle {\frac {2y}{2}}={\frac {200-2x}{2}}}$
${\displaystyle y=100-x}$
${\displaystyle xy=x(100-x)}$

The derivative with respect to ${\displaystyle x}$ is:

{\displaystyle {\begin{aligned}{\frac {d}{dx}}xy&={\frac {d}{dx}}x(100-x)\\&={\frac {d}{dx}}\left(100x-x^{2}\right)\\&=100-2x\end{aligned}}}

Setting this equal to ${\displaystyle 0}$

${\displaystyle 0=100-2x}$
${\displaystyle 2x=100}$
${\displaystyle x=50}$

reveals that ${\displaystyle x=50}$ is our only critical point. Now retrieve the endpoints by determining the interval to which ${\displaystyle x}$ is restricted. Since width is positive, then ${\displaystyle x>0}$, and since ${\displaystyle x=100-y}$, that implies that ${\displaystyle x<100}$. Plug in critical point ${\displaystyle 50}$, as well as endpoints ${\displaystyle 0}$ and ${\displaystyle 100}$, into ${\displaystyle xy=x(100-x)}$, and the results are ${\displaystyle 2500,0,}$ and ${\displaystyle 0}$ respectively.

Therefore, the greatest area attainable with a rectangle of ${\displaystyle 200}$ feet of fencing is ${\displaystyle 50\times 50=2500}$. [8]

Functions of more than one variable

For functions of more than one variable, similar conditions apply. For example, in the (enlargeable) figure on the right, the necessary conditions for a local maximum are similar to those of a function with only one variable. The first partial derivatives as to z (the variable to be maximized) are zero at the maximum (the glowing dot on top in the figure). The second partial derivatives are negative. These are only necessary, not sufficient, conditions for a local maximum, because of the possibility of a saddle point. For use of these conditions to solve for a maximum, the function z must also be differentiable throughout. The second partial derivative test can help classify the point as a relative maximum or relative minimum. In contrast, there are substantial differences between functions of one variable and functions of more than one variable in the identification of global extrema. For example, if a bounded differentiable function f defined on a closed interval in the real line has a single critical point, which is a local minimum, then it is also a global minimum (use the intermediate value theorem and Rolle's theorem to prove this by reductio ad impossibile). In two and more dimensions, this argument fails. This is illustrated by the function

${\displaystyle f(x,y)=x^{2}+y^{2}(1-x)^{3},\qquad x,y\in \mathbb {R} ,}$

whose only critical point is at (0,0), which is a local minimum with f(0,0) = 0. However, it cannot be a global one, because f(2,3) = −5.

Maxima or minima of a functional

If the domain of a function for which an extremum is to be found consists itself of functions (i.e. if an extremum is to be found of a functional), then the extremum is found using the calculus of variations.

In relation to sets

Maxima and minima can also be defined for sets. In general, if an ordered set S has a greatest element m, then m is a maximal element of the set, also denoted as ${\displaystyle \max(S)}$. [4] Furthermore, if S is a subset of an ordered set T and m is the greatest element of S with (respect to order induced by T), then m is a least upper bound of S in T. Similar results hold for least element, minimal element and greatest lower bound. The maximum and minimum function for sets are used in databases, and can be computed rapidly, since the maximum (or minimum) of a set can be computed from the maxima of a partition; formally, they are self-decomposable aggregation functions.

In the case of a general partial order, the least element (i.e., one that is smaller than all others) should not be confused with a minimal element (nothing is smaller). Likewise, a greatest element of a partially ordered set (poset) is an upper bound of the set which is contained within the set, whereas a maximal elementm of a poset A is an element of A such that if mb (for any b in A), then m = b. Any least element or greatest element of a poset is unique, but a poset can have several minimal or maximal elements. If a poset has more than one maximal element, then these elements will not be mutually comparable.

In a totally ordered set, or chain, all elements are mutually comparable, so such a set can have at most one minimal element and at most one maximal element. Then, due to mutual comparability, the minimal element will also be the least element, and the maximal element will also be the greatest element. Thus in a totally ordered set, we can simply use the terms minimum and maximum.

If a chain is finite, then it will always have a maximum and a minimum. If a chain is infinite, then it need not have a maximum or a minimum. For example, the set of natural numbers has no maximum, though it has a minimum. If an infinite chain S is bounded, then the closure Cl(S) of the set occasionally has a minimum and a maximum, in which case they are called the greatest lower bound and the least upper bound of the set S, respectively.

Related Research Articles

In mathematics, differential calculus is a subfield of calculus that studies the rates at which quantities change. It is one of the two traditional divisions of calculus, the other being integral calculus—the study of the area beneath a curve.

Mathematical optimization or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. Optimization problems of sorts arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

In mathematical optimization, the method of Lagrange multipliers is a strategy for finding the local maxima and minima of a function subject to equality constraints. It is named after the mathematician Joseph-Louis Lagrange. The basic idea is to convert a constrained problem into a form such that the derivative test of an unconstrained problem can still be applied. The relationship between the gradient of the function and gradients of the constraints rather naturally leads to a reformulation of the original problem, known as the Lagrangian function.

The calculus of variations is a field of mathematical analysis that uses variations, which are small changes in functions and functionals, to find maxima and minima of functionals: mappings from a set of functions to the real numbers. Functionals are often expressed as definite integrals involving functions and their derivatives. Functions that maximize or minimize functionals may be found using the Euler–Lagrange equation of the calculus of variations.

In mathematics, especially in order theory, a maximal element of a subset S of some preordered set is an element of S that is not smaller than any other element in S. A minimal element of a subset S of some preordered set is defined dually as an element of S that is not greater than any other element in S.

In differential calculus and differential geometry, an inflection point, point of inflection, flex, or inflection is a point on a smooth plane curve at which the curvature changes sign. In particular, in the case of the graph of a function, it is a point where the function changes from being concave to convex, or vice versa.

In mathematics, catastrophe theory is a branch of bifurcation theory in the study of dynamical systems; it is also a particular special case of more general singularity theory in geometry.

This is a glossary of some terms used in various branches of mathematics that are related to the fields of order, lattice, and domain theory. Note that there is a structured list of order topics available as well. Other helpful resources might be the following overview articles:

In mathematics, a saddle point or minimax point is a point on the surface of the graph of a function where the slopes (derivatives) in orthogonal directions are all zero, but which is not a local extremum of the function. An example of a saddle point is when there is a critical point with a relative minimum along one axial direction and at a relative maximum along the crossing axis. However, a saddle point need not be in this form. For example, the function has a critical point at that is a saddle point since it is neither a relative maximum nor relative minimum, but it does not have a relative maximum or relative minimum in the -direction.

In mathematics, especially in order theory, the greatest element of a subset of a partially ordered set (poset) is an element of that is greater than every other element of . The term least element is defined dually, that is, it is an element of that is smaller than every other element of

In calculus, a derivative test uses the derivatives of a function to locate the critical points of a function and determine whether each point is a local maximum, a local minimum, or a saddle point. Derivative tests can also give information about the concavity of a function.

In mathematics, particularly in calculus, a stationary point of a differentiable function of one variable is a point on the graph of the function where the function's derivative is zero. Informally, it is a point where the function "stops" increasing or decreasing.

In mathematics, approximation theory is concerned with how functions can best be approximated with simpler functions, and with quantitatively characterizing the errors introduced thereby. Note that what is meant by best and simpler will depend on the application.

The golden-section search is a technique for finding an extremum of a function inside a specified interval. For a strictly unimodal function with an extremum inside the interval, it will find that extremum, while for an interval containing multiple extrema, it will converge to one of them. If the only extremum on the interval is on a boundary of the interval, it will converge to that boundary point. The method operates by successively narrowing the range of values on the specified interval, which makes it relatively slow, but very robust. The technique derives its name from the fact that the algorithm maintains the function values for four points whose three interval widths are in the ratio 2-φ:2φ-3:2-φ where φ is the golden ratio. These ratios are maintained for each iteration and are maximally efficient. Excepting boundary points, when searching for a minimum, the central point is always less than or equal to the outer points, assuring that a minimum is contained between the outer points. The converse is true when searching for a maximum. The algorithm is the limit of Fibonacci search for many function evaluations. Fibonacci search and golden-section search were discovered by Kiefer (1953).

Critical point is a wide term used in many branches of mathematics.

In mathematics, in the branch of combinatorics, a graded poset is a partially ordered set (poset) P equipped with a rank functionρ from P to the set N of all natural numbers. ρ must satisfy the following two properties:

In mathematics, Fermat's theorem is a method to find local maxima and minima of differentiable functions on open sets by showing that every local extremum of the function is a stationary point. Fermat's theorem is a theorem in real analysis, named after Pierre de Fermat.

In computer vision, blob detection methods are aimed at detecting regions in a digital image that differ in properties, such as brightness or color, compared to surrounding regions. Informally, a blob is a region of an image in which some properties are constant or approximately constant; all the points in a blob can be considered in some sense to be similar to each other. The most common method for blob detection is convolution.

In the field of calculus of variations in mathematics, the method of Lagrange multipliers on Banach spaces can be used to solve certain infinite-dimensional constrained optimization problems. The method is a generalization of the classical method of Lagrange multipliers as used to find extrema of a function of finitely many variables.

Most of the terms listed in Wikipedia glossaries are already defined and explained within Wikipedia itself. However, glossaries like this one are useful for looking up, comparing and reviewing large numbers of terms together. You can help enhance this page by adding new terms or writing definitions for existing ones.

References

1. Stewart, James (2008). (6th ed.). Brooks/Cole. ISBN   978-0-495-01166-8.
2. Larson, Ron; Edwards, Bruce H. (2009). Calculus (9th ed.). Brooks/Cole. ISBN   978-0-547-16702-2.
3. Thomas, George B.; Weir, Maurice D.; Hass, Joel (2010). Thomas' Calculus: Early Transcendentals (12th ed.). Addison-Wesley. ISBN   978-0-321-58876-0.
4. "List of Calculus and Analysis Symbols". Math Vault. 2020-05-11. Retrieved 2020-08-30.
5. Problems in mathematical analysis. Demidovǐc, Boris P., Baranenkov, G. Moscow(IS): Moskva. 1964. ISBN   0846407612. OCLC   799468131.CS1 maint: others (link)
6. Weisstein, Eric W. "Minimum". mathworld.wolfram.com. Retrieved 2020-08-30.
7. Weisstein, Eric W. "Maximum". mathworld.wolfram.com. Retrieved 2020-08-30.
8. Garrett, Paul. "Minimization and maximization refresher".