Normed vector space

Hierarchy of mathematical spaces. Normed vector spaces are a superset of inner product spaces and a subset of metric spaces, which in turn is a subset of topological spaces.

In mathematics, a normed vector space or normed space is a vector space over the real or complex numbers on which a norm is defined. ^[1] A norm is a generalization of the intuitive notion of "length" in the physical world. If ${\displaystyle V}$ is a vector space over ${\displaystyle K}$, where ${\displaystyle K}$ is a field equal to ${\displaystyle \mathbb {R} }$ or to ${\displaystyle \mathbb {C} }$, then a norm on ${\displaystyle V}$ is a map ${\displaystyle V\to \mathbb {R} }$, typically denoted by ${\displaystyle \lVert \cdot \rVert }$, satisfying the following four axioms:

1. Non-negativity: for every ${\displaystyle x\in V}$,${\displaystyle \;\lVert x\rVert \geq 0}$.
2. Positive definiteness: for every ${\displaystyle x\in V}$, ${\displaystyle \;\lVert x\rVert =0}$ if and only if ${\displaystyle x}$ is the zero vector.
3. Absolute homogeneity: for every ${\displaystyle \lambda \in K}$ and ${\displaystyle x\in V}$,
   $${\displaystyle \lVert \lambda x\rVert =|\lambda |\,\lVert x\rVert }$$
4. Triangle inequality: for every ${\displaystyle x\in V}$ and ${\displaystyle y\in V}$,
   $${\displaystyle \|x+y\|\leq \|x\|+\|y\|.}$$

If ${\displaystyle V}$ is a real or complex vector space as above, and ${\displaystyle \lVert \cdot \rVert }$ is a norm on ${\displaystyle V}$, then the ordered pair ${\displaystyle (V,\lVert \cdot \rVert )}$ is called a normed vector space. If it is clear from context which norm is intended, then it is common to denote the normed vector space simply by ${\displaystyle V}$.

A norm induces a distance, called its (norm) induced metric , by the formula

$${\displaystyle d(x,y)=\|y-x\|.}$$

which makes any normed vector space into a metric space and a topological vector space. If this metric space is complete then the normed space is a Banach space . Every normed vector space can be "uniquely extended" to a Banach space, which makes normed spaces intimately related to Banach spaces. Every Banach space is a normed space but converse is not true. For example, the set of the finite sequences of real numbers can be normed with the Euclidean norm, but it is not complete for this norm.

An inner product space is a normed vector space whose norm is the square root of the inner product of a vector and itself. The Euclidean norm of a Euclidean vector space is a special case that allows defining Euclidean distance by the formula

$${\displaystyle d(A,B)=\|{\overrightarrow {AB}}\|.}$$

The study of normed spaces and Banach spaces is a fundamental part of functional analysis, a major subfield of mathematics.

Definition

See also: Seminormed space

A normed vector space is a vector space equipped with a norm. A seminormed vector space is a vector space equipped with a seminorm.

A useful variation of the triangle inequality is

$${\displaystyle \|x-y\|\geq |\|x\|-\|y\||}$$

for any vectors ${\displaystyle x}$ and ${\displaystyle y.}$

This also shows that a vector norm is a (uniformly) continuous function.

Property 3 depends on a choice of norm ${\displaystyle |\alpha |}$ on the field of scalars. When the scalar field is ${\displaystyle \mathbb {R} }$ (or more generally a subset of ${\displaystyle \mathbb {C} }$), this is usually taken to be the ordinary absolute value, but other choices are possible. For example, for a vector space over ${\displaystyle \mathbb {Q} }$ one could take ${\displaystyle |\alpha |}$ to be the ${\displaystyle p}$-adic absolute value.

Topological structure

If ${\displaystyle (V,\|\,\cdot \,\|)}$ is a normed vector space, the norm ${\displaystyle \|\,\cdot \,\|}$ induces a metric (a notion of distance) and therefore a topology on ${\displaystyle V.}$ This metric is defined in the natural way: the distance between two vectors ${\displaystyle \mathbf {u} }$ and ${\displaystyle \mathbf {v} }$ is given by ${\displaystyle \|\mathbf {u} -\mathbf {v} \|.}$ This topology is precisely the weakest topology which makes ${\displaystyle \|\,\cdot \,\|}$ continuous and which is compatible with the linear structure of ${\displaystyle V}$ in the following sense:

1. The vector addition ${\displaystyle \,+\,:V\times V\to V}$ is jointly continuous with respect to this topology. This follows directly from the triangle inequality.
2. The scalar multiplication ${\displaystyle \,\cdot \,:\mathbb {K} \times V\to V,}$ where ${\displaystyle \mathbb {K} }$ is the underlying scalar field of ${\displaystyle V,}$ is jointly continuous. This follows from the triangle inequality and homogeneity of the norm.

Similarly, for any seminormed vector space we can define the distance between two vectors ${\displaystyle \mathbf {u} }$ and ${\displaystyle \mathbf {v} }$ as ${\displaystyle \|\mathbf {u} -\mathbf {v} \|.}$ This turns the seminormed space into a pseudometric space (notice this is weaker than a metric) and allows the definition of notions such as continuity and convergence. To put it more abstractly every seminormed vector space is a topological vector space and thus carries a topological structure which is induced by the semi-norm.

Of special interest are complete normed spaces, which are known as Banach spaces . Every normed vector space ${\displaystyle V}$ sits as a dense subspace inside some Banach space; this Banach space is essentially uniquely defined by ${\displaystyle V}$ and is called the completion of ${\displaystyle V.}$

Two norms on the same vector space are called equivalent if they define the same topology. On a finite-dimensional vector space, all norms are equivalent but this is not true for infinite dimensional vector spaces.

All norms on a finite-dimensional vector space are equivalent from a topological viewpoint as they induce the same topology (although the resulting metric spaces need not be the same). ^[2] And since any Euclidean space is complete, we can thus conclude that all finite-dimensional normed vector spaces are Banach spaces. A normed vector space ${\displaystyle V}$ is locally compact if and only if the unit ball ${\displaystyle B=\{x:\|x\|\leq 1\}}$ is compact, which is the case if and only if ${\displaystyle V}$ is finite-dimensional; this is a consequence of Riesz's lemma. (In fact, a more general result is true: a topological vector space is locally compact if and only if it is finite-dimensional. The point here is that we don't assume the topology comes from a norm.)

The topology of a seminormed vector space has many nice properties. Given a neighbourhood system ${\displaystyle {\mathcal {N}}(0)}$ around 0 we can construct all other neighbourhood systems as

$${\displaystyle {\mathcal {N}}(x)=x+{\mathcal {N}}(0):=\{x+N:N\in {\mathcal {N}}(0)\}}$$

with

$${\displaystyle x+N:=\{x+n:n\in N\}.}$$

Moreover, there exists a neighbourhood basis for the origin consisting of absorbing and convex sets. As this property is very useful in functional analysis, generalizations of normed vector spaces with this property are studied under the name locally convex spaces.

A norm (or seminorm) ${\displaystyle \|\cdot \|}$ on a topological vector space ${\displaystyle (X,\tau )}$ is continuous if and only if the topology ${\displaystyle \tau _{\|\cdot \|}}$ that ${\displaystyle \|\cdot \|}$ induces on ${\displaystyle X}$ is coarser than ${\displaystyle \tau }$ (meaning, ${\displaystyle \tau _{\|\cdot \|}\subseteq \tau }$), which happens if and only if there exists some open ball ${\displaystyle B}$ in ${\displaystyle (X,\|\cdot \|)}$ (such as maybe ${\displaystyle \{x\in X:\|x\|<1\}}$ for example) that is open in ${\displaystyle (X,\tau )}$ (said different, such that ${\displaystyle B\in \tau }$).

Normable spaces

See also: Metrizable topological vector space § Normability

A topological vector space ${\displaystyle (X,\tau )}$ is called normable if there exists a norm ${\displaystyle \|\cdot \|}$ on ${\displaystyle X}$ such that the canonical metric ${\displaystyle (x,y)\mapsto \|y-x\|}$ induces the topology ${\displaystyle \tau }$ on ${\displaystyle X.}$ The following theorem is due to Kolmogorov: ^[3]

Kolmogorov's normability criterion : A Hausdorff topological vector space is normable if and only if there exists a convex, von Neumann bounded neighborhood of ${\displaystyle 0\in X.}$

A product of a family of normable spaces is normable if and only if only finitely many of the spaces are non-trivial (that is, ${\displaystyle \neq \{0\}}$). ^[3] Furthermore, the quotient of a normable space ${\displaystyle X}$ by a closed vector subspace ${\displaystyle C}$ is normable, and if in addition ${\displaystyle X}$'s topology is given by a norm ${\displaystyle \|\,\cdot ,\|}$ then the map ${\displaystyle X/C\to \mathbb {R} }$ given by ${\textstyle x+C\mapsto \inf _{c\in C}\|x+c\|}$ is a well defined norm on ${\displaystyle X/C}$ that induces the quotient topology on ${\displaystyle X/C.}$ ^[4]

If ${\displaystyle X}$ is a Hausdorff locally convex topological vector space then the following are equivalent:

1. ${\displaystyle X}$ is normable.
2. ${\displaystyle X}$ has a bounded neighborhood of the origin.
3. the strong dual space ${\displaystyle X_{b}^{\prime }}$ of ${\displaystyle X}$ is normable. ^[5]
4. the strong dual space ${\displaystyle X_{b}^{\prime }}$ of ${\displaystyle X}$ is metrizable. ^[5]

Furthermore, ${\displaystyle X}$ is finite dimensional if and only if ${\displaystyle X_{\sigma }^{\prime }}$ is normable (here ${\displaystyle X_{\sigma }^{\prime }}$ denotes ${\displaystyle X^{\prime }}$ endowed with the weak-* topology).

The topology ${\displaystyle \tau }$ of the Fréchet space ${\displaystyle C^{\infty }(K),}$ as defined in the article on spaces of test functions and distributions, is defined by a countable family of norms but it is not a normable space because there does not exist any norm ${\displaystyle \|\cdot \|}$ on ${\displaystyle C^{\infty }(K)}$ such that the topology that this norm induces is equal to ${\displaystyle \tau .}$

Even if a metrizable topological vector space has a topology that is defined by a family of norms, then it may nevertheless still fail to be normable space (meaning that its topology can not be defined by any single norm). An example of such a space is the Fréchet space ${\displaystyle C^{\infty }(K),}$ whose definition can be found in the article on spaces of test functions and distributions, because its topology ${\displaystyle \tau }$ is defined by a countable family of norms but it is not a normable space because there does not exist any norm ${\displaystyle \|\cdot \|}$ on ${\displaystyle C^{\infty }(K)}$ such that the topology this norm induces is equal to ${\displaystyle \tau .}$ In fact, the topology of a locally convex space ${\displaystyle X}$ can be a defined by a family of norms on ${\displaystyle X}$ if and only if there exists at least one continuous norm on ${\displaystyle X.}$ ^[6]

Linear maps and dual spaces

The most important maps between two normed vector spaces are the continuous linear maps. Together with these maps, normed vector spaces form a category.

The norm is a continuous function on its vector space. All linear maps between finite dimensional vector spaces are also continuous.

An isometry between two normed vector spaces is a linear map ${\displaystyle f}$ which preserves the norm (meaning ${\displaystyle \|f(\mathbf {v} )\|=\|\mathbf {v} \|}$ for all vectors ${\displaystyle \mathbf {v} }$). Isometries are always continuous and injective. A surjective isometry between the normed vector spaces ${\displaystyle V}$ and ${\displaystyle W}$ is called an isometric isomorphism, and ${\displaystyle V}$ and ${\displaystyle W}$ are called isometrically isomorphic. Isometrically isomorphic normed vector spaces are identical for all practical purposes.

When speaking of normed vector spaces, we augment the notion of dual space to take the norm into account. The dual ${\displaystyle V^{\prime }}$ of a normed vector space ${\displaystyle V}$ is the space of all continuous linear maps from ${\displaystyle V}$ to the base field (the complexes or the reals) — such linear maps are called "functionals". The norm of a functional ${\displaystyle \varphi }$ is defined as the supremum of ${\displaystyle |\varphi (\mathbf {v} )|}$ where ${\displaystyle \mathbf {v} }$ ranges over all unit vectors (that is, vectors of norm ${\displaystyle 1}$) in ${\displaystyle V.}$ This turns ${\displaystyle V^{\prime }}$ into a normed vector space. An important theorem about continuous linear functionals on normed vector spaces is the Hahn–Banach theorem.

Normed spaces as quotient spaces of seminormed spaces

The definition of many normed spaces (in particular, Banach spaces) involves a seminorm defined on a vector space and then the normed space is defined as the quotient space by the subspace of elements of seminorm zero. For instance, with the ${\displaystyle L^{p}}$ spaces, the function defined by

$${\displaystyle \|f\|_{p}=\left(\int |f(x)|^{p}\;dx\right)^{1/p}}$$

is a seminorm on the vector space of all functions on which the Lebesgue integral on the right hand side is defined and finite. However, the seminorm is equal to zero for any function supported on a set of Lebesgue measure zero. These functions form a subspace which we "quotient out", making them equivalent to the zero function.

Finite product spaces

Given ${\displaystyle n}$ seminormed spaces ${\displaystyle \left(X_{i},q_{i}\right)}$ with seminorms ${\displaystyle q_{i}:X_{i}\to \mathbb {R} ,}$ denote the product space by

$${\displaystyle X:=\prod _{i=1}^{n}X_{i}}$$

where vector addition defined as

$${\displaystyle \left(x_{1},\ldots ,x_{n}\right)+\left(y_{1},\ldots ,y_{n}\right):=\left(x_{1}+y_{1},\ldots ,x_{n}+y_{n}\right)}$$

and scalar multiplication defined as

$${\displaystyle \alpha \left(x_{1},\ldots ,x_{n}\right):=\left(\alpha x_{1},\ldots ,\alpha x_{n}\right).}$$

Define a new function ${\displaystyle q:X\to \mathbb {R} }$ by

$${\displaystyle q\left(x_{1},\ldots ,x_{n}\right):=\sum _{i=1}^{n}q_{i}\left(x_{i}\right),}$$

which is a seminorm on ${\displaystyle X.}$ The function ${\displaystyle q}$ is a norm if and only if all ${\displaystyle q_{i}}$ are norms.

More generally, for each real ${\displaystyle p\geq 1}$ the map ${\displaystyle q:X\to \mathbb {R} }$ defined by

$${\displaystyle q\left(x_{1},\ldots ,x_{n}\right):=\left(\sum _{i=1}^{n}q_{i}\left(x_{i}\right)^{p}\right)^{\frac {1}{p}}}$$

is a semi norm. For each ${\displaystyle p}$ this defines the same topological space.

A straightforward argument involving elementary linear algebra shows that the only finite-dimensional seminormed spaces are those arising as the product space of a normed space and a space with trivial seminorm. Consequently, many of the more interesting examples and applications of seminormed spaces occur for infinite-dimensional vector spaces.

See also

• Banach space, normed vector spaces which are complete with respect to the metric induced by the norm
• Banach–Mazur compactum  – Set of n-dimensional subspaces of a normed space made into a compact metric space.
• Finsler manifold, where the length of each tangent vector is determined by a norm
• Inner product space, normed vector spaces where the norm is given by an inner product
• Kolmogorov's normability criterion  – Characterization of normable spaces
• Locally convex topological vector space – a vector space with a topology defined by convex open sets
• Space (mathematics) – mathematical set with some added structure
• Topological vector space  – Vector space with a notion of nearness

References

1. Callier, Frank M. (1991). Linear System Theory. New York: Springer-Verlag. ISBN   0-387-97573-X.
2. Kedlaya, Kiran S. (2010), p-adic differential equations, Cambridge Studies in Advanced Mathematics, vol. 125, Cambridge University Press, CiteSeerX   10.1.1.165.270 , ISBN   978-0-521-76879-5 , Theorem 1.3.6
3. Schaefer 1999, p. 41.
4. Schaefer 1999, p. 42.
5. Trèves 2006, pp. 136–149, 195–201, 240–252, 335–390, 420–433.
6. Jarchow 1981, p. 130. sfn error: no target: CITEREFJarchow1981 (help)

Bibliography

• Rudin, Walter (1991). Functional Analysis. International Series in Pure and Applied Mathematics. Vol. 8 (Second ed.). New York, NY: McGraw-Hill Science/Engineering/Math. ISBN   978-0-07-054236-5. OCLC   21163277.
• Banach, Stefan (1932). Théorie des Opérations Linéaires [Theory of Linear Operations](PDF). Monografie Matematyczne (in French). Vol. 1. Warszawa: Subwencji Funduszu Kultury Narodowej. Zbl   0005.20901. Archived from the original (PDF) on 2014-01-11. Retrieved 2020-07-11.
• Rolewicz, Stefan (1987), Functional analysis and control theory: Linear systems, Mathematics and its Applications (East European Series), vol. 29 (Translated from the Polish by Ewa Bednarczuk ed.), Dordrecht; Warsaw: D. Reidel Publishing Co.; PWN—Polish Scientific Publishers, pp. xvi+524, doi:10.1007/978-94-015-7758-8, ISBN   90-277-2186-6, MR   0920371, OCLC   13064804
• Schaefer, H. H. (1999). Topological Vector Spaces. New York, NY: Springer New York Imprint Springer. ISBN   978-1-4612-7155-0. OCLC   840278135.
• Trèves, François (2006) [1967]. Topological Vector Spaces, Distributions and Kernels. Mineola, N.Y.: Dover Publications. ISBN   978-0-486-45352-1. OCLC   853623322.

External links

• Media related to Normed spaces at Wikimedia Commons