Bessel's inequality

In mathematics, especially functional analysis, Bessel's inequality is a statement about the coefficients of an element ${\displaystyle x}$ in a Hilbert space with respect to an orthonormal sequence. The inequality is named for F. W. Bessel, who derived a special case of it in 1828. ^[1]

Conceptually, the inequality is a generalization of the Pythagorean theorem to infinite-dimensional spaces. It states that the "energy" of a vector ${\displaystyle x}$, given by ${\displaystyle \|x\|^{2}}$, is greater than or equal to the sum of the energies of its projections onto a set of perpendicular basis directions. The value ${\displaystyle |\langle x,e_{k}\rangle |^{2}}$ represents the energy contribution along a specific direction ${\displaystyle e_{k}}$, and the inequality guarantees that the sum of these contributions cannot exceed the total energy of ${\displaystyle x}$.

When the orthonormal sequence forms a complete orthonormal basis, Bessel's inequality becomes an equality known as Parseval's identity. This signifies that the sum of the energies of the projections equals the total energy of the vector, meaning no energy is "lost." The inequality is a crucial tool for establishing the convergence of Fourier series and other series expansions in Hilbert spaces.

Statement of the inequality

Let ${\displaystyle H}$ be a Hilbert space and let ${\displaystyle e_{1},e_{2},\dots }$ be an orthonormal sequence in ${\displaystyle H}$. Then for any vector ${\displaystyle x}$ in ${\displaystyle H}$, Bessel's inequality states:

${\displaystyle \sum _{k=1}^{\infty }\left\vert \left\langle x,e_{k}\right\rangle \right\vert ^{2}\leq \left\Vert x\right\Vert ^{2}}$

where ⟨·,·⟩ denotes the inner product in the Hilbert space ${\displaystyle H}$, and ${\displaystyle \|\cdot \|}$ denotes the norm induced by the inner product. ^{[2] [3] [4]}

The terms ${\displaystyle \langle x,e_{k}\rangle }$ are the Fourier coefficients of ${\displaystyle x}$ with respect to the sequence ${\displaystyle (e_{k})}$. The inequality implies that the series of the squared magnitudes of these coefficients converges. This allows for the definition of the vector ${\displaystyle x'}$, which is the projection of ${\displaystyle x}$ onto the subspace spanned by the orthonormal sequence:

${\displaystyle x'=\sum _{k=1}^{\infty }\left\langle x,e_{k}\right\rangle e_{k}}$

Bessel's inequality guarantees that this series converges. If the sequence ${\displaystyle (e_{k})}$ is a complete orthonormal basis, then ${\displaystyle x'=x}$, and the inequality becomes an equality known as Parseval's identity.

Proof

The inequality follows from the non-negativity of the norm of a vector. For any natural number ${\displaystyle n}$, let

${\displaystyle x_{n}=\sum _{k=1}^{n}\langle x,e_{k}\rangle e_{k}}$

This vector ${\displaystyle x_{n}}$ is the projection of ${\displaystyle x}$ onto the subspace spanned by the first ${\displaystyle n}$ basis vectors. The vector ${\displaystyle x-x_{n}}$ is orthogonal to this subspace, and thus orthogonal to ${\displaystyle x_{n}}$ itself. By the Pythagorean theorem for inner product spaces, we have ${\displaystyle \|x\|^{2}=\|x_{n}\|^{2}+\|x-x_{n}\|^{2}}$. The proof proceeds by computing ${\displaystyle \|x-x_{n}\|^{2}}$:

${\displaystyle {\begin{aligned}0\leq \left\|x-\sum _{k=1}^{n}\langle x,e_{k}\rangle e_{k}\right\|^{2}&=\left\langle x-\sum _{k=1}^{n}\langle x,e_{k}\rangle e_{k},\;x-\sum _{j=1}^{n}\langle x,e_{j}\rangle e_{j}\right\rangle \\&=\|x\|^{2}-\sum _{k=1}^{n}{\overline {\langle x,e_{k}\rangle }}\langle x,e_{k}\rangle -\sum _{j=1}^{n}\langle x,e_{j}\rangle \langle e_{j},x\rangle +\sum _{k=1}^{n}\sum _{j=1}^{n}{\overline {\langle x,e_{k}\rangle }}\langle x,e_{j}\rangle \langle e_{k},e_{j}\rangle \\&=\|x\|^{2}-\sum _{k=1}^{n}|\langle x,e_{k}\rangle |^{2}-\sum _{j=1}^{n}|\langle x,e_{j}\rangle |^{2}+\sum _{k=1}^{n}|\langle x,e_{k}\rangle |^{2}\\&=\|x\|^{2}-\sum _{k=1}^{n}|\langle x,e_{k}\rangle |^{2}\end{aligned}}}$

This holds for any ${\displaystyle n\geq 1}$. Since the partial sums are non-negative and bounded above by ${\displaystyle \|x\|^{2}}$, the series ${\displaystyle \sum _{k=1}^{\infty }|\langle x,e_{k}\rangle |^{2}}$ converges and its sum is less than or equal to ${\displaystyle \|x\|^{2}}$.

Fourier series

In the theory of Fourier series, in the particular case of the Fourier orthonormal system, we get if ${\displaystyle f\colon \mathbb {R} \to \mathbb {C} }$ has period ${\displaystyle T}$,

${\displaystyle \sum _{k\in \mathbb {Z} }\left\vert \int _{0}^{T}e^{-2\pi ikt/T}f(t)\,\mathrm {d} t\right\vert ^{2}\leq T\int _{0}^{T}\vert f(t)\vert ^{2}\,\mathrm {d} t.}$

In the particular case where ${\displaystyle f\colon \mathbb {R} \to \mathbb {R} }$, one has then

${\displaystyle \left\vert \int _{0}^{T}f(t)\,\mathrm {d} t\right\vert ^{2}+2\sum _{n=1}^{\infty }\left\vert \int _{0}^{T}\cos(2\pi kt/T)f(t)\,\mathrm {d} t\right\vert ^{2}+2\sum _{n=1}^{\infty }\left\vert \int _{0}^{T}\sin(2\pi kt/T)f(t)\,\mathrm {d} t\right\vert ^{2}\leq T\int _{0}^{T}\vert f(t)\vert ^{2}\,\mathrm {d} t.}$

Non countable case

More generally, if ${\displaystyle H}$ is a pre-Hilbert space and ${\displaystyle (e_{\alpha })_{\alpha \in A}}$ is an orthonormal system, then for every ${\displaystyle x\in H}$ ^[1]

${\displaystyle \sum _{\alpha \in A}|\langle x,e_{\alpha }\rangle |^{2}\leq \lVert x\rVert ^{2}}$

This is proved by noting that if ${\displaystyle F\subseteq A}$ is finite, then

${\displaystyle \sum _{\alpha \in F}|\langle x,e_{\alpha }\rangle |^{2}\leq \lVert x\rVert ^{2}}$

and then by definition of infinite sum

${\displaystyle \sum _{\alpha \in A}|\langle x,e_{\alpha }\rangle |^{2}=\sup {\Bigl \{}\sum _{\alpha \in F}|\langle x,e_{\alpha }\rangle |^{2}:F\subseteq A{\text{ is finite}}{\Bigr \}}\leq \lVert x\rVert ^{2}.}$

See also

• Cauchy–Schwarz inequality
• Parseval's theorem

References

1. "Bessel inequality - Encyclopedia of Mathematics".
2. Saxe, Karen (2001-12-07). Beginning Functional Analysis. Springer Science & Business Media. p. 82. ISBN   9780387952246.
3. Zorich, Vladimir A.; Cooke, R. (2004-01-22). Mathematical Analysis II. Springer Science & Business Media. pp. 508–509. ISBN   9783540406334.
4. Vetterli, Martin; Kovačević, Jelena; Goyal, Vivek K. (2014-09-04). Foundations of Signal Processing. Cambridge University Press. p. 83. ISBN   9781139916578.

External links

• "Bessel inequality", Encyclopedia of Mathematics , EMS Press, 2001 [1994]
• Bessel's Inequality the article on Bessel's Inequality on MathWorld.

This article incorporates material from Bessel inequality on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.