Variational analysis

Last updated

In mathematics, variational analysis is the combination and extension of methods from convex optimization and the classical calculus of variations to a more general theory. [1] This includes the more general problems of optimization theory, including topics in set-valued analysis, e.g. generalized derivatives.

Contents

In the Mathematics Subject Classification scheme (MSC2010), the field of "Set-valued and variational analysis" is coded by "49J53". [2]

History

While this area of mathematics has a long history, the first use of the term "Variational analysis" in this sense was in an eponymous book by R. Tyrrell Rockafellar and Roger J-B Wets. [1] [ failed verification ]

Existence of minima

A classical result is that a lower semicontinuous function on a compact set attains its minimum. Results from variational analysis such as Ekeland's variational principle allow us to extend this result of lower semicontinuous functions on non-compact sets provided that the function has a lower bound and at the cost of adding a small perturbation to the function.

Generalized derivatives

The classical Fermat's theorem says that if a differentiable function attains its minimum at a point, and that point is an interior point of its domain, then its derivative must be zero at that point. For problems where a smooth function must be minimized subject to constraints which can be expressed in the form of other smooth functions being equal to zero, the method of Lagrange multipliers, another classical result, gives necessary conditions in terms of the derivatives of the function.

The ideas of these classical results can be extended to nondifferentiable convex functions by generalizing the notion of derivative to that of subderivative. Further generalization of the notion of the derivative such as the Clarke generalized gradient allow the results to be extended to nonsmooth locally Lipschitz functions. [3]

See also

Citations

  1. 1 2 Rockafellar & Wets 2009.
  2. "49J53 Set-valued and variational analysis". 5 July 2010.
  3. Frank H. Clarke, Optimization and Nonsmooth Analysis, SIAM, 1990.

Related Research Articles

<span class="mw-page-title-main">Mathematical optimization</span> Study of mathematical algorithms for optimization problems

Mathematical optimization or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

<span class="mw-page-title-main">Semi-continuity</span> Property of functions which is weaker than continuity

In mathematical analysis, semicontinuity is a property of extended real-valued functions that is weaker than continuity. An extended real-valued function is uppersemicontinuous at a point if, roughly speaking, the function values for arguments near are not much higher than

In mathematical analysis, in particular the subfields of convex analysis and optimization, a proper convex function is an extended real-valued convex function with a non-empty domain, that never takes on the value and also is not identically equal to

<span class="mw-page-title-main">Pierre-Louis Lions</span> French mathematician (born 1956)

Pierre-Louis Lions is a French mathematician. He is known for a number of contributions to the fields of partial differential equations and the calculus of variations. He was a recipient of the 1994 Fields Medal and the 1991 Prize of the Philip Morris tobacco and cigarette company.

In convex analysis and the calculus of variations, both branches of mathematics, a pseudoconvex function is a function that behaves like a convex function with respect to finding its local minima, but need not actually be convex. Informally, a differentiable function is pseudoconvex if it is increasing in any direction where it has a positive directional derivative. The property must hold in all of the function domain, and not only for nearby points.

<span class="mw-page-title-main">Convex analysis</span>

Convex analysis is the branch of mathematics devoted to the study of properties of convex functions and convex sets, often with applications in convex minimization, a subdomain of optimization theory.

<span class="mw-page-title-main">Subderivative</span> Generalization of derivatives to real-valued functions

In mathematics, subderivatives generalizes the derivative to convex functions which are not necessarily differentiable. The set of subderivatives at a point is called the subdifferential at that point. Subderivatives arise in convex analysis, the study of convex functions, often in connection to convex optimization.

<span class="mw-page-title-main">Epigraph (mathematics)</span>

In mathematics, the epigraph or supergraph of a function valued in the extended real numbers is the set

<span class="mw-page-title-main">Set-valued function</span> Function whose values are sets (mathematics)

A set-valued function is a mathematical function that maps elements from one set, the domain of the function, to subsets of another set. Set-valued functions are used in a variety of mathematical fields, including optimization, control theory and game theory.

<span class="mw-page-title-main">Hypograph (mathematics)</span>

In mathematics, the hypograph or subgraph of a function is the set of points lying on or below its graph. A related definition is that of such a function's epigraph, which is the set of points on or above the function's graph.

Roger Jean-Baptiste Robert Wets is a "pioneer" in stochastic programming and a leader in variational analysis who publishes as Roger J-B Wets. His research, expositions, graduate students, and his collaboration with R. Tyrrell Rockafellar have had a profound influence on optimization theory, computations, and applications. Since 2009, Wets has been a distinguished research professor at the mathematics department of the University of California, Davis.

<span class="mw-page-title-main">R. Tyrrell Rockafellar</span> American mathematician

Ralph Tyrrell Rockafellar is an American mathematician and one of the leading scholars in optimization theory and related fields of analysis and combinatorics. He is the author of four major books including the landmark text "Convex Analysis" (1970), which has been cited more than 27,000 times according to Google Scholar and remains the standard reference on the subject, and "Variational Analysis" for which the authors received the Frederick W. Lanchester Prize from the Institute for Operations Research and the Management Sciences (INFORMS).

Convexity is an important topic in economics. In the Arrow–Debreu model of general economic equilibrium, agents have convex budget sets and convex preferences: At equilibrium prices, the budget hyperplane supports the best attainable indifference curve. The profit function is the convex conjugate of the cost function. Convex analysis is the standard tool for analyzing textbook economics. Non‑convex phenomena in economics have been studied with nonsmooth analysis, which generalizes convex analysis.

<span class="mw-page-title-main">Ivar Ekeland</span> French mathematician

Ivar I. Ekeland is a French mathematician of Norwegian descent. Ekeland has written influential monographs and textbooks on nonlinear functional analysis, the calculus of variations, and mathematical economics, as well as popular books on mathematics, which have been published in French, English, and other languages. Ekeland is known as the author of Ekeland's variational principle and for his use of the Shapley–Folkman lemma in optimization theory. He has contributed to the periodic solutions of Hamiltonian systems and particularly to the theory of Kreĭn indices for linear systems. Ekeland is cited in the credits of Steven Spielberg's 1993 movie Jurassic Park as an inspiration of the fictional chaos theory specialist Ian Malcom appearing in Michael Crichton's 1990 novel Jurassic Park.

In convex analysis, a branch of mathematics, the effective domain extends of the domain of a function defined for functions that take values in the extended real number line

<span class="mw-page-title-main">Jean-Jacques Moreau</span> French mathematician and mechanician

Jean Jacques Moreau was a French mathematician and mechanician. He normally published under the name J. J. Moreau.

Frank "Francis" H. Clarke is a Canadian and French mathematician.

In mathematics, the Clarke generalized derivatives are types generalized of derivatives that allow for the differentiation of nonsmooth functions. The Clarke derivatives were introduced by Francis Clarke in 1975.

References