Riesz's lemma

For another result sometimes called Riesz's lemma, see Riesz representation theorem. For more theorems that are called Riesz's theorem, see Riesz theorem.

Riesz's lemma (after Frigyes Riesz) is a lemma in functional analysis. It specifies (often easy to check) conditions that guarantee that a subspace in a normed vector space is dense. The lemma may also be called the Riesz lemma or Riesz inequality. It can be seen as a substitute for orthogonality when the normed space is not an inner product space.

Statement

Riesz's lemma ^[1]  — Let ${\displaystyle Y}$ be a closed proper vector subspace of a normed space ${\displaystyle (X,\|\cdot \|)}$ and let ${\displaystyle \alpha }$ be any real number satisfying ${\displaystyle 0<\alpha <1.}$ Then there exists a vector ${\displaystyle u}$ in ${\displaystyle X}$ of unit norm ${\displaystyle \|u\|=1}$ such that ${\displaystyle \|u-y\|\geq \alpha }$ for all ${\displaystyle y}$ in ${\displaystyle Y.}$

If ${\displaystyle X}$ is a reflexive Banach space then this conclusion is also true when ${\displaystyle \alpha =1.}$ ^[2]

Metric reformulation

As usual, let ${\displaystyle d(x,y):=\|x-y\|}$ denote the canonical metric induced by the norm, call the set ${\displaystyle \{x\in X:\|x\|=1\}}$ of all vectors that are a distance of ${\displaystyle 1}$ from the origin the unit sphere , and denote the distance from a point ${\displaystyle u}$ to the set ${\displaystyle Y\subseteq X}$ by

$${\displaystyle d(u,Y)~:=~\inf _{y\in Y}d(u,y)~=~\inf _{y\in Y}\|u-y\|.}$$

The inequality ${\displaystyle \alpha \leq d(u,Y)}$ holds if and only if ${\displaystyle \|u-y\|\geq \alpha }$ for all ${\displaystyle y\in Y,}$ and it formally expresses the notion that the distance between ${\displaystyle u}$ and ${\displaystyle Y}$ is at least ${\displaystyle \alpha .}$ Because every vector subspace (such as ${\displaystyle Y}$) contains the origin ${\displaystyle 0,}$ substituting ${\displaystyle y:=0}$ in this infimum shows that ${\displaystyle d(u,Y)\leq \|u\|}$ for every vector ${\displaystyle u\in X.}$ In particular, ${\displaystyle d(u,Y)\leq 1}$ when ${\displaystyle \|u\|=1}$ is a unit vector.

Using this new notation, the conclusion of Riesz's lemma may be restated more succinctly as: ${\displaystyle \alpha \leq d(u,Y)\leq 1=\|u\|}$ holds for some ${\displaystyle u\in X.}$

Using this new terminology, Riesz's lemma may also be restated in plain English as:

Given any closed proper vector subspace of a normed space ${\displaystyle X,}$ for any desired minimum distance ${\displaystyle \alpha }$ less than ${\displaystyle 1,}$ there exists some vector in the unit sphere of ${\displaystyle X}$ that is at least this desired distance away from the subspace.

The proof ^[3] can be found in functional analysis texts such as Kreyszig. ^[4] An online proof from Prof. Paul Garrett is available.

Proof

Consider any ${\displaystyle v\in X-Y}$ and denote its distance from ${\displaystyle Y}$ by ${\displaystyle a}$. Clearly, ${\displaystyle a>0}$ since ${\displaystyle Y}$ is closed. Take any ${\displaystyle \alpha \in (0,1)}$. By the definition of an infimum, there is a ${\displaystyle y_{0}\in Y}$ such that

${\displaystyle a\leq \left\|v-y_{0}\right\|\leq {\frac {a}{\alpha }}}$

(1)

(note that ${\displaystyle a/\alpha >a}$ since ${\displaystyle 0<\alpha <1}$). Let

${\displaystyle z=c\left(v-y_{0}\right)\quad {\text{ where }}\quad c={\frac {1}{\left\|v-y_{0}\right\|}}.}$

Then ${\displaystyle \|z\|=1}$, and we show that ${\displaystyle \|z-y\|\geq \alpha }$ for every ${\displaystyle y\in Y}$. We have

${\displaystyle {\begin{aligned}\|z-y\|&=\left\|c\left(v-y_{0}\right)-y\right\|\\&=c\left\|v-y_{0}-c^{-1}y\right\|\\&=c\left\|v-y_{1}\right\|\end{aligned}}}$

where

${\displaystyle y_{1}=y_{0}+c^{-1}y.}$

The form of ${\displaystyle y_{1}}$ shows that ${\displaystyle y_{1}\in Y}$. Hence ${\displaystyle \left\|v-y_{1}\right\|\geq a}$, by the definition of ${\displaystyle a}$. Writing ${\displaystyle c}$ out and using ( 1 ), we obtain

${\displaystyle \|z-y\|=c\left\|v-y_{1}\right\|\geq ca={\frac {a}{\left\|v-y_{0}\right\|}}\geq {\frac {a}{a/\alpha }}=\alpha .}$

Since ${\displaystyle y\in Y}$ was arbitrary, this completes the proof.

Minimum distances ${\displaystyle \alpha }$ not satisfying the hypotheses

When ${\displaystyle X=\{0\}}$ is trivial then it has no proper vector subspace ${\displaystyle Y,}$ and so Riesz's lemma holds vacuously for all real numbers ${\displaystyle \alpha \in \mathbb {R} .}$ The remainder of this section will assume that ${\displaystyle X\neq \{0\},}$ which guarantees that a unit vector exists.

The inclusion of the hypotheses ${\displaystyle 0<\alpha <1}$ can be explained by considering the three cases: ${\displaystyle \alpha \leq 0}$, ${\displaystyle \alpha =1,}$ and ${\displaystyle \alpha >1.}$ The lemma holds when ${\displaystyle \alpha \leq 0}$ since every unit vector ${\displaystyle u\in X}$ satisfies the conclusion ${\displaystyle \alpha \leq 0\leq d(u,Y)\leq 1=\|u\|.}$ The hypotheses ${\displaystyle 0<\alpha }$ is included solely to exclude this trivial case and is sometimes omitted from the lemma's statement.

Riesz's lemma is always false when ${\displaystyle \alpha >1}$ because for every unit vector ${\displaystyle u\in X,}$ the required inequality ${\displaystyle \|u-y\|\geq \alpha }$ fails to hold for ${\displaystyle y:=0\in Y}$ (since ${\displaystyle \|u-0\|=1<\alpha }$). Another of consequence of ${\displaystyle d(u,Y)>1}$ being impossible is that the inequality ${\displaystyle d(u,Y)\geq 1}$ holds if and only if equality ${\displaystyle d(u,Y)=1}$ holds.

Reflexivity

See also: Reflexive space

This leaves only the case ${\displaystyle \alpha =1}$ for consideration, in which case the statement of Riesz's lemma becomes:

for every closed proper vector subspace ${\displaystyle Y}$ of ${\displaystyle X,}$ there exists some vector ${\displaystyle u}$ of unit norm that satisfies ${\displaystyle d(u,Y)=1.}$

When ${\displaystyle X}$ is a Banach space, then this statement is true if and only if ${\displaystyle X}$ is a reflexive space. ^[2] Explicitly, a Banach space ${\displaystyle X}$ is reflexive if and only if for every closed proper vector subspace ${\displaystyle Y,}$ there is some vector ${\displaystyle u}$ on the unit sphere of ${\displaystyle X}$ that is always at least a distance of ${\displaystyle 1=d(u,Y)}$ away from the subspace.

For example, if the reflexive Banach space ${\displaystyle X=\mathbb {R} ^{3}}$ is endowed with the usual ${\displaystyle \|\cdot \|_{2}}$ Euclidean norm and if ${\displaystyle Y=\mathbb {R} \times \mathbb {R} \times \{0\}}$ is the ${\displaystyle x-y}$ plane then the points ${\displaystyle u=(0,0,\pm 1)}$ satisfy the conclusion ${\displaystyle d(u,Y)=1.}$ If ${\displaystyle Z=\{(0,0)\}\times \mathbb {R} }$ is ${\displaystyle z}$-axis then every point ${\displaystyle u}$ belonging to the unit circle in the ${\displaystyle x-y}$ plane satisfies the conclusion ${\displaystyle d(u,Z)=1.}$ But if ${\displaystyle X=\mathbb {R} ^{3}}$ was endowed with the ${\displaystyle \|\cdot \|_{1}}$ taxicab norm (instead of the Euclidean norm), then the conclusion ${\displaystyle d(u,Z)=1}$ would be satisfied by every point ${\displaystyle u=(x,y,0)}$ belonging to the "diamond" ${\displaystyle |x|+|y|=1}$ in the ${\displaystyle x-y}$ plane (a square with vertices at ${\displaystyle (\pm 1,0,0)}$ and ${\displaystyle (0,\pm 1,0).}$)

In a non-reflexive Banach space, such as the Lebesgue space ${\displaystyle \ell _{\infty }(\mathbb {N} )}$ of all bounded sequences, Riesz's lemma does not hold for ${\displaystyle \alpha =1.}$ ^[5]

However, every finite dimensional normed space is a reflexive Banach space, so Riesz's lemma does holds for ${\displaystyle \alpha =1}$ when the normed space is finite-dimensional, as will now be shown. When the dimension of ${\displaystyle X}$ is finite then the closed unit ball ${\displaystyle B\subseteq X}$ is compact. Since the distance function ${\displaystyle d(\,\cdot \,,Y)}$ is continuous, its image on the closed unit ball ${\displaystyle B}$ must be a compact subset of the real line, proving the claim.

Some consequences

Riesz's lemma guarantees that for any given ${\displaystyle 0<\alpha <1,}$ every infinite-dimensional normed space contains a sequence ${\displaystyle x_{1},x_{2},\ldots }$ of (distinct) unit vectors satisfying ${\displaystyle \|x_{n}-x_{m}\|>\alpha }$ for ${\displaystyle m\neq n;}$ or stated in plain English, these vectors are all separated from each other by a distance of more than ${\displaystyle \alpha }$ while simultaneously also all lying on the unit sphere. Such an infinite sequence of vectors cannot be found in the unit sphere of any finite dimensional normed space (just consider for example the unit circle in ${\displaystyle \mathbb {R} ^{2}}$).

This sequence can be constructed by induction for any constant ${\displaystyle 0<\alpha <1.}$ Start by picking any element ${\displaystyle x_{1}}$ from the unit sphere. Let ${\displaystyle Y_{n-1}}$ be the linear span of ${\displaystyle \{x_{1},\ldots ,x_{n-1}\}}$ and (using Riesz's lemma) pick ${\displaystyle x_{n}}$ from the unit sphere such that

${\displaystyle d\left(x_{n},Y_{n-1}\right)>\alpha }$ where ${\displaystyle d(x_{n},Y)=\inf _{y\in Y}\|x_{n}-y\|.}$

This sequence ${\displaystyle x_{1},x_{2},\ldots }$ contains no convergent subsequence, which implies that the closed unit ball is not compact.

Characterization of finite dimension

Main article: F. Riesz's theorem

Riesz's lemma can be applied directly to show that the unit ball of an infinite-dimensional normed space ${\displaystyle X}$ is never compact. This can be used to characterize finite dimensional normed spaces: if ${\displaystyle X}$ is a normed vector space, then ${\displaystyle X}$ is finite dimensional if and only if the closed unit ball in ${\displaystyle X}$ is compact.

More generally, if a topological vector space ${\displaystyle X}$ is locally compact, then it is finite dimensional. The converse of this is also true. Namely, if a topological vector space is finite dimensional, it is locally compact. ^[6] Therefore local compactness characterizes finite-dimensionality. This classical result is also attributed to Riesz. A short proof can be sketched as follows: let ${\displaystyle C}$ be a compact neighborhood of the origin in ${\displaystyle X.}$ By compactness, there are ${\displaystyle c_{1},\ldots ,c_{n}\in C}$ such that

$${\displaystyle C~\subseteq ~\left(c_{1}+{\tfrac {1}{2}}C\right)\cup \cdots \cup \left(c_{n}+{\tfrac {1}{2}}C\right).}$$

We claim that the finite dimensional subspace ${\displaystyle Y}$ spanned by ${\displaystyle \{c_{1},\ldots ,c_{n}\}}$ is dense in ${\displaystyle X,}$ or equivalently, its closure is ${\displaystyle X.}$ Since ${\displaystyle X}$ is the union of scalar multiples of ${\displaystyle C,}$ it is sufficient to show that ${\displaystyle C\subseteq Y.}$ By induction, for every ${\displaystyle m,}$

$${\displaystyle C~\subseteq ~Y+{\frac {1}{2^{m}}}C.}$$

But compact sets are bounded, so ${\displaystyle C}$ lies in the closure of ${\displaystyle Y.}$ This proves the result. For a different proof based on Hahn–Banach theorem see Crespín (1994). ^[7]

Spectral theory

The spectral properties of compact operators acting on a Banach space are similar to those of matrices. Riesz's lemma is essential in establishing this fact.

Other applications

As detailed in the article on infinite-dimensional Lebesgue measure, this is useful in showing the non-existence of certain measures on infinite-dimensional Banach spaces. Riesz's lemma also shows that the identity operator on a Banach space ${\displaystyle X}$ is compact if and only if ${\displaystyle X}$ is finite-dimensional. ^[8]

See also

• F. Riesz's theorem
• James's Theorem - a characterization of reflexivity given by a condition on the unit ball

References

1. Rynne & Youngson 2008, p. 47.
2. Diestel 1984, p. 6.
3. "Riesz's lemma". PlanetMath .
4. Kreyszig 1978.
5. "An example where the supremum of Riesz's Lemma is not achieved".
6. Tao, Terence (24 May 2011). "Locally compact topological vector spaces".
7. Crespín, Daniel (1994). "Hahn–Banach theorem implies Riesz theorem" (PDF). Portugaliae Mathematica. 51 (2): 217–218. MR   1277990.
8. Kreyszig (1978 , Theorem 2.5-3, 2.5-5)

• Diestel, Joe (1984). Sequences and series in Banach spaces. New York: Springer-Verlag. ISBN   0-387-90859-5. OCLC   9556781.
• Hashimoto, Kazuo; Nakamura, Gen; Oharu, Shinnosuke (1986-01-01). "Riesz's lemma and orthogonality in normed spaces" (PDF). Hiroshima Mathematical Journal. 16 (2). Hiroshima University - Department of Mathematics. doi:10.32917/hmj/1206130429. ISSN   0018-2079.
• Kreyszig, Erwin (1978). Introductory functional analysis with applications. New York: John Wiley & Sons. ISBN   0-471-50731-8. OCLC   2818701.
• Riesz, Frederic; Sz.-Nagy, Béla (1990) [1955]. Functional Analysis. Translated by Boron, Leo F. New York: Dover Publications. ISBN   0-486-66289-6. OCLC   21228994.
• Rynne, Bryan P.; Youngson, Martin A. (2008). Linear Functional Analysis (2nd ed.). London: Springer. ISBN   978-1848000049. OCLC   233972987.