Lipschitz continuity

Last updated August 25, 2024

In mathematical analysis, Lipschitz continuity, named after German mathematician Rudolf Lipschitz, is a strong form of uniform continuity for functions. Intuitively, a Lipschitz continuous function is limited in how fast it can change: there exists a real number such that, for every pair of points on the graph of this function, the absolute value of the slope of the line connecting them is not greater than this real number; the smallest such bound is called the Lipschitz constant of the function (and is related to the modulus of uniform continuity ). For instance, every function that is defined on an interval and has a bounded first derivative is Lipschitz continuous.^[1]

In the theory of differential equations, Lipschitz continuity is the central condition of the Picard–Lindelöf theorem which guarantees the existence and uniqueness of the solution to an initial value problem. A special type of Lipschitz continuity, called contraction, is used in the Banach fixed-point theorem.^[2]

We have the following chain of strict inclusions for functions over a closed and bounded non-trivial interval of the real line:

Continuously differentiable ⊂Lipschitz continuous⊂

\alpha

-Hölder continuous ,

where $0<\alpha \leq 1$ . We also have

Lipschitz continuous⊂ absolutely continuous ⊂ uniformly continuous .

Definitions

Given two metric spaces (X, d_X) and (Y, d_Y), where d_X denotes the metric on the set X and d_Y is the metric on set Y, a function f : X → Y is called Lipschitz continuous if there exists a real constant K ≥ 0 such that, for all x₁ and x₂ in X,

d_{Y}(f(x_{1}),f(x_{2}))\leq Kd_{X}(x_{1},x_{2}).

^[3]

Any such K is referred to as a Lipschitz constant for the function f and f may also be referred to as K-Lipschitz. The smallest constant is sometimes called the (best) Lipschitz constant^[4] of f or the dilation or dilatation^[5]^{: p. 9, Definition 1.4.1}^[6]^[7] of f. If K = 1 the function is called a short map , and if 0 ≤ K < 1 and f maps a metric space to itself, the function is called a contraction .

In particular, a real-valued function f : R → R is called Lipschitz continuous if there exists a positive real constant K such that, for all real x₁ and x₂,

|f(x_{1})-f(x_{2})|\leq K|x_{1}-x_{2}|.

In this case, Y is the set of real numbers R with the standard metric d_Y(y₁, y₂) = |y₁ − y₂|, and X is a subset of R.

In general, the inequality is (trivially) satisfied if x₁ = x₂. Otherwise, one can equivalently define a function to be Lipschitz continuous if and only if there exists a constant K ≥ 0 such that, for all x₁ ≠ x₂,

{\frac {d_{Y}(f(x_{1}),f(x_{2}))}{d_{X}(x_{1},x_{2})}}\leq K.

For real-valued functions of several real variables, this holds if and only if the absolute value of the slopes of all secant lines are bounded by K. The set of lines of slope K passing through a point on the graph of the function forms a circular cone, and a function is Lipschitz if and only if the graph of the function everywhere lies completely outside of this cone (see figure).

A function is called locally Lipschitz continuous if for every x in X there exists a neighborhood U of x such that f restricted to U is Lipschitz continuous. Equivalently, if X is a locally compact metric space, then f is locally Lipschitz if and only if it is Lipschitz continuous on every compact subset of X. In spaces that are not locally compact, this is a necessary but not a sufficient condition.

More generally, a function f defined on X is said to be Hölder continuous or to satisfy a Hölder condition of order α > 0 on X if there exists a constant M≥ 0 such that

d_{Y}(f(x),f(y))\leq Md_{X}(x,y)^{\alpha }

for all x and y in X. Sometimes a Hölder condition of order α is also called a uniform Lipschitz condition of order α > 0.

For a real number K≥ 1, if

{\frac {1}{K}}d_{X}(x_{1},x_{2})\leq d_{Y}(f(x_{1}),f(x_{2}))\leq Kd_{X}(x_{1},x_{2})\quad {\text{ for all }}x_{1},x_{2}\in X,

then f is called K-bilipschitz (also written K-bi-Lipschitz). We say f is bilipschitz or bi-Lipschitz to mean there exists such a K. A bilipschitz mapping is injective, and is in fact a homeomorphism onto its image. A bilipschitz function is the same thing as an injective Lipschitz function whose inverse function is also Lipschitz.

Examples

Lipschitz continuous functions that are everywhere differentiable

The function $f(x)={\sqrt {x^{2}+5}}$ defined for all real numbers is Lipschitz continuous with the Lipschitz constant K = 1, because it is everywhere differentiable and the absolute value of the derivative is bounded above by 1. See the first property listed below under "Properties".
Likewise, the sine function is Lipschitz continuous because its derivative, the cosine function, is bounded above by 1 in absolute value.

Lipschitz continuous functions that are not everywhere differentiable

The function $f(x)=|x|$ defined on the reals is Lipschitz continuous with the Lipschitz constant equal to 1, by the reverse triangle inequality. More generally, a norm on a vector space is Lipschitz continuous with respect to the associated metric, with the Lipschitz constant equal to 1.

Lipschitz continuous functions that are everywhere differentiable but not continuously differentiable

The function $f(x)\;=\;{\begin{cases}x^{2}\sin(1/x)&{\text{if }}x\neq 0\\0&{\text{if }}x=0\end{cases}}$ , whose derivative exists but has an essential discontinuity at $x=0$ .

Continuous functions that are not (globally) Lipschitz continuous

The function f(x) = √x defined on [0, 1] is not Lipschitz continuous. This function becomes infinitely steep as x approaches 0 since its derivative becomes infinite. However, it is uniformly continuous,^[8] and both Hölder continuous of class C^{0, α} for α ≤ 1/2 and also absolutely continuous on [0, 1] (both of which imply the former).

Differentiable functions that are not (locally) Lipschitz continuous

The function f defined by f(0) = 0 and f(x) = x^3/2sin(1/x) for 0<x≤1 gives an example of a function that is differentiable on a compact set while not locally Lipschitz because its derivative function is not bounded. See also the first property below.

Analytic functions that are not (globally) Lipschitz continuous

The exponential function becomes arbitrarily steep as x → ∞, and therefore is not globally Lipschitz continuous, despite being an analytic function.
The function f(x) = x² with domain all real numbers is not Lipschitz continuous. This function becomes arbitrarily steep as x approaches infinity. It is however locally Lipschitz continuous.

Properties

An everywhere differentiable function g : R → R is Lipschitz continuous (with K = sup |g′(x)|) if and only if it has a bounded first derivative; one direction follows from the mean value theorem. In particular, any continuously differentiable function is locally Lipschitz, as continuous functions are locally bounded so its gradient is locally bounded as well.
A Lipschitz function g : R → R is absolutely continuous and therefore is differentiable almost everywhere, that is, differentiable at every point outside a set of Lebesgue measure zero. Its derivative is essentially bounded in magnitude by the Lipschitz constant, and for a < b, the difference g(b) − g(a) is equal to the integral of the derivative g′ on the interval [a, b].
- Conversely, if f : I → R is absolutely continuous and thus differentiable almost everywhere, and satisfies |f′(x)| ≤ K for almost all x in I, then f is Lipschitz continuous with Lipschitz constant at most K.
- More generally, Rademacher's theorem extends the differentiability result to Lipschitz mappings between Euclidean spaces: a Lipschitz map f : U → R^m, where U is an open set in Rⁿ, is almost everywhere differentiable. Moreover, if K is the best Lipschitz constant of f, then $\|Df(x)\|\leq K$ whenever the total derivative Df exists.^{[ citation needed ]}
For a differentiable Lipschitz map $f:U\to \mathbb {R} ^{m}$ the inequality $\|Df\|_{W^{1,\infty }(U)}\leq K$ holds for the best Lipschitz constant $K$ of $f$ . If the domain $U$ is convex then in fact $\|Df\|_{W^{1,\infty }(U)}=K$ .^{[ further explanation needed ]}
Suppose that {f_n} is a sequence of Lipschitz continuous mappings between two metric spaces, and that all f_n have Lipschitz constant bounded by some K. If f_n converges to a mapping f uniformly, then f is also Lipschitz, with Lipschitz constant bounded by the same K. In particular, this implies that the set of real-valued functions on a compact metric space with a particular bound for the Lipschitz constant is a closed and convex subset of the Banach space of continuous functions. This result does not hold for sequences in which the functions may have unbounded Lipschitz constants, however. In fact, the space of all Lipschitz functions on a compact metric space is a subalgebra of the Banach space of continuous functions, and thus dense in it, an elementary consequence of the Stone–Weierstrass theorem (or as a consequence of Weierstrass approximation theorem, because every polynomial is locally Lipschitz continuous).
Every Lipschitz continuous map is uniformly continuous, and hence continuous. More generally, a set of functions with bounded Lipschitz constant forms an equicontinuous set. The Arzelà–Ascoli theorem implies that if {f_n} is a uniformly bounded sequence of functions with bounded Lipschitz constant, then it has a convergent subsequence. By the result of the previous paragraph, the limit function is also Lipschitz, with the same bound for the Lipschitz constant. In particular the set of all real-valued Lipschitz functions on a compact metric space X having Lipschitz constant ≤ K is a locally compact convex subset of the Banach space C(X).
For a family of Lipschitz continuous functions f_α with common constant, the function $\sup _{\alpha }f_{\alpha }$ (and $\inf _{\alpha }f_{\alpha }$ ) is Lipschitz continuous as well, with the same Lipschitz constant, provided it assumes a finite value at least at a point.
If U is a subset of the metric space M and f : U → R is a Lipschitz continuous function, there always exist Lipschitz continuous maps M → R which extend f and have the same Lipschitz constant as f (see also Kirszbraun theorem). An extension is provided by

{\tilde {f}}(x):=\inf _{u\in U}\{f(u)+k\,d(x,u)\},

where k is a Lipschitz constant for f on U.

Lipschitz manifolds

A Lipschitz structure on a topological manifold is defined using an atlas of charts whose transition maps are bilipschitz; this is possible because bilipschitz maps form a pseudogroup. Such a structure allows one to define locally Lipschitz maps between such manifolds, similarly to how one defines smooth maps between smooth manifolds: if $M$ and $N$ are Lipschitz manifolds, then a function $f:M\to N$ is locally Lipschitz if and only if for every pair of coordinate charts $\phi :U\to M$ and $\psi :V\to N$ , where $U$ and $V$ are open sets in the corresponding Euclidean spaces, the composition $\psi ^{-1}\circ f\circ \phi :U\cap (f\circ \phi )^{-1}(\psi (V))\to V$ is locally Lipschitz. This definition does not rely on defining a metric on $M$ or $N$ .^[9]

This structure is intermediate between that of a piecewise-linear manifold and a topological manifold: a PL structure gives rise to a unique Lipschitz structure.^[10] While Lipschitz manifolds are closely related to topological manifolds, Rademacher's theorem allows one to do analysis, yielding various applications.^[9]

One-sided Lipschitz

Let F(x) be an upper semi-continuous function of x, and that F(x) is a closed, convex set for all x. Then F is one-sided Lipschitz^[11] if

(x_{1}-x_{2})^{T}(F(x_{1})-F(x_{2}))\leq C\Vert x_{1}-x_{2}\Vert ^{2}

for some C and for all x₁ and x₂.

It is possible that the function F could have a very large Lipschitz constant but a moderately sized, or even negative, one-sided Lipschitz constant. For example, the function

{\begin{cases}F:\mathbf {R} ^{2}\to \mathbf {R} ,\\F(x,y)=-50(y-\cos(x))\end{cases}}

has Lipschitz constant K = 50 and a one-sided Lipschitz constant C = 0. An example which is one-sided Lipschitz but not Lipschitz continuous is F(x) = e^−x, with C = 0.

Related Research Articles

In mathematics, a metric space is a set together with a notion of distance between its elements, usually called points. The distance is measured by a function called a metric or distance function. Metric spaces are the most general setting for studying many of the concepts of mathematical analysis and geometry.

In mathematics, mathematical physics and the theory of stochastic processes, a harmonic function is a twice continuously differentiable function $where U is an open subset of ⁠ ⁠ that satisfies Laplace's equation, that is, everywhere on U . This is usually written as or$

In functional analysis and related areas of mathematics, Fréchet spaces, named after Maurice Fréchet, are special topological vector spaces. They are generalizations of Banach spaces. All Banach and Hilbert spaces are Fréchet spaces. Spaces of infinitely differentiable functions are typical examples of Fréchet spaces, many of which are typically not Banach spaces.

In calculus and real analysis, absolute continuity is a smoothness property of functions that is stronger than continuity and uniform continuity. The notion of absolute continuity allows one to obtain generalizations of the relationship between the two central operations of calculus—differentiation and integration. This relationship is commonly characterized in the framework of Riemann integration, but with absolute continuity it may be formulated in terms of Lebesgue integration. For real-valued functions on the real line, two interrelated notions appear: absolute continuity of functions and absolute continuity of measures. These two notions are generalized in different directions. The usual derivative of a function is related to the Radon–Nikodym derivative, or density, of a measure. We have the following chains of inclusions for functions over a compact subset of the real line:

This is a glossary of some terms used in Riemannian geometry and metric geometry — it doesn't cover the terminology of differential topology.

The Arzelà–Ascoli theorem is a fundamental result of mathematical analysis giving necessary and sufficient conditions to decide whether every sequence of a given family of real-valued continuous functions defined on a closed and bounded interval has a uniformly convergent subsequence. The main condition is the equicontinuity of the family of functions. The theorem is the basis of many proofs in mathematics, including that of the Peano existence theorem in the theory of ordinary differential equations, Montel's theorem in complex analysis, and the Peter–Weyl theorem in harmonic analysis and various results concerning compactness of integral operators.

In mathematics, Frobenius' theorem gives necessary and sufficient conditions for finding a maximal set of independent solutions of an overdetermined system of first-order homogeneous linear partial differential equations. In modern geometric terms, given a family of vector fields, the theorem gives necessary and sufficient integrability conditions for the existence of a foliation by maximal integral manifolds whose tangent bundles are spanned by the given vector fields. The theorem generalizes the existence theorem for ordinary differential equations, which guarantees that a single vector field always gives rise to integral curves; Frobenius gives compatibility conditions under which the integral curves of r vector fields mesh into coordinate grids on r-dimensional integral manifolds. The theorem is foundational in differential topology and calculus on manifolds.

In mathematics, a Sobolev space is a vector space of functions equipped with a norm that is a combination of L^p-norms of the function together with its derivatives up to a given order. The derivatives are understood in a suitable weak sense to make the space complete, i.e. a Banach space. Intuitively, a Sobolev space is a space of functions possessing sufficiently many derivatives for some application domain, such as partial differential equations, and equipped with a norm that measures both the size and regularity of a function.

In mathematics, specifically the study of differential equations, the Picard–Lindelöf theorem gives a set of conditions under which an initial value problem has a unique solution. It is also known as Picard's existence theorem, the Cauchy–Lipschitz theorem, or the existence and uniqueness theorem.

In mathematical analysis, a modulus of continuity is a function ω : [0, ∞] → [0, ∞] used to measure quantitatively the uniform continuity of functions. So, a function f : I → R admits ω as a modulus of continuity if

In mathematical analysis, the smoothness of a function is a property measured by the number, called differentiability class, of continuous derivatives it has over its domain.

In mathematics, a differentiable manifold is a type of manifold that is locally similar enough to a vector space to allow one to apply calculus. Any manifold can be described by a collection of charts (atlas). One may then apply ideas from calculus while working within the individual charts, since each chart lies within a vector space to which the usual rules of calculus apply. If the charts are suitably compatible, then computations done in one chart are valid in any other differentiable chart.

In geometric topology, Busemann functions are used to study the large-scale geometry of geodesics in Hadamard spaces and in particular Hadamard manifolds. They are named after Herbert Busemann, who introduced them; he gave an extensive treatment of the topic in his 1955 book "The geometry of geodesics".

In mathematics, a real or complex-valued function $f$ on $d$ -dimensional Euclidean space satisfies a Hölder condition, or is Hölder continuous, when there are real constants $C \geq 0$ , $α > 0$ , such that $for all x and y in the domain of f . More generally, the condition can be formulated for functions between any two metric spaces. The number is called the exponent of the Hölder condition. A function on an interval satisfying the condition with α > 1 is constant. If α = 1, then the function satisfies a Lipschitz condition. For any α > 0, the condition implies the function is uniformly continuous. The condition is named after Otto Hölder.$

In mathematics, there is in mathematical analysis a class of Sobolev inequalities, relating norms including those of Sobolev spaces. These are used to prove the Sobolev embedding theorem, giving inclusions between certain Sobolev spaces, and the Rellich–Kondrachov theorem showing that under slightly stronger conditions some Sobolev spaces are compactly embedded in others. They are named after Sergei Lvovich Sobolev.

In mathematics, the Poincaré inequality is a result in the theory of Sobolev spaces, named after the French mathematician Henri Poincaré. The inequality allows one to obtain bounds on a function using bounds on its derivatives and the geometry of its domain of definition. Such bounds are of great importance in the modern, direct methods of the calculus of variations. A very closely related result is Friedrichs' inequality.

In mathematics, the Lebesgue differentiation theorem is a theorem of real analysis, which states that for almost every point, the value of an integrable function is the limiting average taken around the point. The theorem is named for Henri Lebesgue.

In mathematics, two metrics on the same underlying set are said to be equivalent if the resulting metric spaces share certain properties. Equivalence is a weaker notion than isometry; equivalent metrics do not have to be literally the same. Instead, it is one of several ways of generalizing equivalence of norms to general metric spaces.

In mathematics, convenient vector spaces are locally convex vector spaces satisfying a very mild completeness condition.

In mathematics, calculus on Euclidean space is a generalization of calculus of functions in one or several variables to calculus of functions on Euclidean space $as well as a finite-dimensional real vector space. This calculus is also known as advanced calculus, especially in the United States. It is similar to multivariable calculus but is somewhat more sophisticated in that it uses linear algebra more extensively and covers some concepts from differential geometry such as differential forms and Stokes' formula in terms of differential forms. This extensive use of linear algebra also allows a natural generalization of multivariable calculus to calculus on Banach spaces or topological vector spaces.$

References

↑ Sohrab, H. H. (2003). Basic Real Analysis. Vol. 231. Birkhäuser. p. 142. ISBN 0-8176-4211-0.
↑ Thomson, Brian S.; Bruckner, Judith B.; Bruckner, Andrew M. (2001). Elementary Real Analysis. Prentice-Hall. p. 623. ISBN 978-0-13-019075-8.
↑ Searcóid, Mícheál Ó (2006), "Lipschitz Functions", Metric Spaces, Springer undergraduate mathematics series, Berlin, New York: Springer-Verlag, ISBN 978-1-84628-369-7
↑ Benyamini, Yoav; Lindenstrauss, Joram (2000). Geometric Nonlinear Functional Analysis. American Mathematical Society. p. 11. ISBN 0-8218-0835-4.
↑ Burago, Dmitri; Burago, Yuri; Ivanov, Sergei (2001). A Course in Metric Geometry. American Mathematical Society. ISBN 0-8218-2129-6.
↑ Mahroo, Omar A; Shalchi, Zaid; Hammond, Christopher J (2014). "'Dilatation' and 'dilation': trends in use on both sides of the Atlantic". British Journal of Ophthalmology. 98 (6): 845–846. doi:10.1136/bjophthalmol-2014-304986. PMID 24568871.
↑ Gromov, Mikhael (1999). "Quantitative Homotopy Theory". In Rossi, Hugo (ed.). Prospects in Mathematics: Invited Talks on the Occasion of the 250th Anniversary of Princeton University, March 17-21, 1996, Princeton University. American Mathematical Society. p. 46. ISBN 0-8218-0975-X.
↑ Robbin, Joel W., Continuity and Uniform Continuity (PDF)
1 2 Rosenberg, Jonathan (1988). "Applications of analysis on Lipschitz manifolds". Miniconferences on harmonic analysis and operator algebras (Canberra, 1987). Canberra: Australian National University. pp. 269–283. MR 954004
↑ "Topology of manifolds", Encyclopedia of Mathematics , EMS Press, 2001 [1994]
↑ Donchev, Tzanko; Farkhi, Elza (1998). "Stability and Euler Approximation of One-sided Lipschitz Differential Inclusions". SIAM Journal on Control and Optimization. 36 (2): 780–796. doi:10.1137/S0363012995293694.

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[1] Sohrab, H. H. (2003). Basic Real Analysis. Vol. 231. Birkhäuser. p. 142. ISBN 0-8176-4211-0.

[2] Thomson, Brian S.; Bruckner, Judith B.; Bruckner, Andrew M. (2001). Elementary Real Analysis. Prentice-Hall. p. 623. ISBN 978-0-13-019075-8.

[3] Searcóid, Mícheál Ó (2006), "Lipschitz Functions", Metric Spaces, Springer undergraduate mathematics series, Berlin, New York: Springer-Verlag, ISBN 978-1-84628-369-7

[4] Benyamini, Yoav; Lindenstrauss, Joram (2000). Geometric Nonlinear Functional Analysis. American Mathematical Society. p. 11. ISBN 0-8218-0835-4.

[5] Burago, Dmitri; Burago, Yuri; Ivanov, Sergei (2001). A Course in Metric Geometry. American Mathematical Society. ISBN 0-8218-2129-6.

[6] Mahroo, Omar A; Shalchi, Zaid; Hammond, Christopher J (2014). "'Dilatation' and 'dilation': trends in use on both sides of the Atlantic". British Journal of Ophthalmology. 98 (6): 845–846. doi:10.1136/bjophthalmol-2014-304986. PMID 24568871.

[7] Gromov, Mikhael (1999). "Quantitative Homotopy Theory". In Rossi, Hugo (ed.). Prospects in Mathematics: Invited Talks on the Occasion of the 250th Anniversary of Princeton University, March 17-21, 1996, Princeton University. American Mathematical Society. p. 46. ISBN 0-8218-0975-X.

[8] Robbin, Joel W., Continuity and Uniform Continuity (PDF)

[Rosenberg-9] 1 2 Rosenberg, Jonathan (1988). "Applications of analysis on Lipschitz manifolds". Miniconferences on harmonic analysis and operator algebras (Canberra, 1987). Canberra: Australian National University. pp. 269–283. MR 954004

[10] "Topology of manifolds", Encyclopedia of Mathematics , EMS Press, 2001 [1994]

[11] Donchev, Tzanko; Farkhi, Elza (1998). "Stability and Euler Approximation of One-sided Lipschitz Differential Inclusions". SIAM Journal on Control and Optimization. 36 (2): 780–796. doi:10.1137/S0363012995293694.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]