Dual norm

Last updated

In functional analysis, the dual norm is a measure of size for a continuous linear function defined on a normed vector space.

Contents

Definition

Let be a normed vector space with norm and let denote its continuous dual space. The dual norm of a continuous linear functional belonging to is the non-negative real number defined [1] by any of the following equivalent formulas:

where and denote the supremum and infimum, respectively. The constant map is the origin of the vector space and it always has norm If then the only linear functional on is the constant map and moreover, the sets in the last two rows will both be empty and consequently, their supremums will equal instead of the correct value of

Importantly, a linear function is not, in general, guaranteed to achieve its norm on the closed unit ball meaning that there might not exist any vector of norm such that (if such a vector does exist and if then would necessarily have unit norm ). R.C. James proved James's theorem in 1964, which states that a Banach space is reflexive if and only if every bounded linear function achieves its norm on the closed unit ball. [2] It follows, in particular, that every non-reflexive Banach space has some bounded linear functional that does not achieve its norm on the closed unit ball. However, the Bishop–Phelps theorem guarantees that the set of bounded linear functionals that achieve their norm on the unit sphere of a Banach space is a norm-dense subset of the continuous dual space. [3] [4]

The map defines a norm on (See Theorems 1 and 2 below.) The dual norm is a special case of the operator norm defined for each (bounded) linear map between normed vector spaces. Since the ground field of ( or ) is complete, is a Banach space. The topology on induced by turns out to be stronger than the weak-* topology on

The double dual of a normed linear space

The double dual (or second dual) of is the dual of the normed vector space . There is a natural map . Indeed, for each in define

The map is linear, injective, and distance preserving. [5] In particular, if is complete (i.e. a Banach space), then is an isometry onto a closed subspace of . [6]

In general, the map is not surjective. For example, if is the Banach space consisting of bounded functions on the real line with the supremum norm, then the map is not surjective. (See space). If is surjective, then is said to be a reflexive Banach space. If then the space is a reflexive Banach space.

Examples

Dual norm for matrices

The Frobenius norm defined by

is self-dual, i.e., its dual norm is

The spectral norm, a special case of the induced norm when , is defined by the maximum singular values of a matrix, that is,

has the nuclear norm as its dual norm, which is defined by

for any matrix where denote the singular values[ citation needed ].

If the Schatten -norm on matrices is dual to the Schatten -norm.

Finite-dimensional spaces

Let be a norm on The associated dual norm, denoted is defined as

(This can be shown to be a norm.) The dual norm can be interpreted as the operator norm of interpreted as a matrix, with the norm on , and the absolute value on :

From the definition of dual norm we have the inequality

which holds for all and [7] The dual of the dual norm is the original norm: we have for all (This need not hold in infinite-dimensional vector spaces.)

The dual of the Euclidean norm is the Euclidean norm, since

(This follows from the Cauchy–Schwarz inequality; for nonzero the value of that maximises over is )

The dual of the -norm is the -norm:

and the dual of the -norm is the -norm.

More generally, Hölder's inequality shows that the dual of the -norm is the -norm, where satisfies that is,

As another example, consider the - or spectral norm on . The associated dual norm is

which turns out to be the sum of the singular values,

where This norm is sometimes called the nuclear norm. [8]

Lp and ℓp spaces

For p-norm (also called -norm) of vector is

If satisfy then the and norms are dual to each other and the same is true of the and norms, where is some measure space. In particular the Euclidean norm is self-dual since For , the dual norm is with positive definite.

For the -norm is even induced by a canonical inner product meaning that for all vectors This inner product can expressed in terms of the norm by using the polarization identity. On this is the Euclidean inner product defined by

while for the space associated with a measure space which consists of all square-integrable functions, this inner product is

The norms of the continuous dual spaces of and satisfy the polarization identity, and so these dual norms can be used to define inner products. With this inner product, this dual space is also a Hilbert spaces.

Properties

Given normed vector spaces and let [9] be the collection of all bounded linear mappings (or operators) of into Then can be given a canonical norm.

Theorem 1  Let and be normed spaces. Assigning to each continuous linear operator the scalar

defines a norm on that makes into a normed space. Moreover, if is a Banach space then so is [10]

Proof

A subset of a normed space is bounded if and only if it lies in some multiple of the unit sphere; thus for every if is a scalar, then so that

The triangle inequality in shows that

for every satisfying This fact together with the definition of implies the triangle inequality:

Since is a non-empty set of non-negative real numbers, is a non-negative real number. If then for some which implies that and consequently This shows that is a normed space. [11]

Assume now that is complete and we will show that is complete. Let be a Cauchy sequence in so by definition as This fact together with the relation

implies that is a Cauchy sequence in for every It follows that for every the limit exists in and so we will denote this (necessarily unique) limit by that is:

It can be shown that is linear. If , then for all sufficiently large integers n and m. It follows that

for sufficiently all large Hence so that and This shows that in the norm topology of This establishes the completeness of [12]

When is a scalar field (i.e. or ) so that is the dual space of

Theorem 2  Let be a normed space and for every let

where by definition is a scalar. Then

  1. is a norm that makes a Banach space. [13]
  2. If is the closed unit ball of then for every
    Consequently, is a bounded linear functional on with norm
  3. is weak*-compact.
Proof

Let denote the closed unit ball of a normed space When is the scalar field then so part (a) is a corollary of Theorem 1. Fix There exists [14] such that

but,

for every . (b) follows from the above. Since the open unit ball of is dense in , the definition of shows that if and only if for every . The proof for (c) [15] now follows directly. [16]

As usual, let denote the canonical metric induced by the norm on and denote the distance from a point to the subset by

If is a bounded linear functional on a normed space then for every vector [17]

where denotes the kernel of

See also

Notes

  1. Rudin 1991 , p. 87
  2. Diestel 1984, p. 6.
  3. Bishop, Errett; Phelps, R. R. (1961). "A proof that every Banach space is subreflexive". Bulletin of the American Mathematical Society. 67: 97–98. doi: 10.1090/s0002-9904-1961-10514-4 . MR   0123174.
  4. Lomonosov, Victor (2000). "A counterexample to the Bishop-Phelps theorem in complex spaces". Israel Journal of Mathematics . 115: 25–28. doi:10.1007/bf02810578. MR   1749671. S2CID   53646715.
  5. Rudin 1991 , section 4.5, p. 95
  6. Rudin 1991 , p. 95
  7. This inequality is tight, in the following sense: for any there is a for which the inequality holds with equality. (Similarly, for any there is an that gives equality.)
  8. Boyd & Vandenberghe 2004 , p. 637
  9. Each is a vector space, with the usual definitions of addition and scalar multiplication of functions; this only depends on the vector space structure of , not .
  10. Rudin 1991, p. 92
  11. Rudin 1991 , p. 93
  12. Rudin 1991 , p. 93
  13. Aliprantis & Border 2006, p. 230
  14. Rudin 1991 , Theorem 3.3 Corollary, p. 59
  15. Rudin 1991 , Theorem 3.15 The Banach–Alaoglu theorem algorithm, p. 68
  16. Rudin 1991 , p. 94
  17. Hashimoto, Nakamura & Oharu 1986, p. 281.

Related Research Articles

In mathematics, more specifically in functional analysis, a Banach space is a complete normed vector space. Thus, a Banach space is a vector space with a metric that allows the computation of vector length and distance between vectors and is complete in the sense that a Cauchy sequence of vectors always converges to a well-defined limit that is within the space.

<span class="mw-page-title-main">Functional analysis</span> Area of mathematics

Functional analysis is a branch of mathematical analysis, the core of which is formed by the study of vector spaces endowed with some kind of limit-related structure and the linear functions defined on these spaces and suitably respecting these structures. The historical roots of functional analysis lie in the study of spaces of functions and the formulation of properties of transformations of functions such as the Fourier transform as transformations defining, for example, continuous or unitary operators between function spaces. This point of view turned out to be particularly useful for the study of differential and integral equations.

The Hahn–Banach theorem is a central tool in functional analysis. It allows the extension of bounded linear functionals defined on a vector subspace of some vector space to the whole space, and it also shows that there are "enough" continuous linear functionals defined on every normed vector space to make the study of the dual space "interesting". Another version of the Hahn–Banach theorem is known as the Hahn–Banach separation theorem or the hyperplane separation theorem, and has numerous uses in convex geometry.

<span class="mw-page-title-main">Normed vector space</span> Vector space on which a distance is defined

In mathematics, a normed vector space or normed space is a vector space over the real or complex numbers on which a norm is defined. A norm is a generalization of the intuitive notion of "length" in the physical world. If is a vector space over , where is a field equal to or to , then a norm on is a map , typically denoted by , satisfying the following four axioms:

  1. Non-negativity: for every ,.
  2. Positive definiteness: for every , if and only if is the zero vector.
  3. Absolute homogeneity: for every and ,
  4. Triangle inequality: for every and ,

In mathematics, the Lp spaces are function spaces defined using a natural generalization of the p-norm for finite-dimensional vector spaces. They are sometimes called Lebesgue spaces, named after Henri Lebesgue, although according to the Bourbaki group they were first introduced by Frigyes Riesz.

In the area of mathematics known as functional analysis, a reflexive space is a locally convex topological vector space for which the canonical evaluation map from into its bidual is a homeomorphism. A normed space is reflexive if and only if this canonical evaluation map is surjective, in which case this evaluation map is an isometric isomorphism and the normed space is a Banach space. Those spaces for which the canonical evaluation map is surjective are called semi-reflexive spaces.

In functional analysis and related areas of mathematics, Fréchet spaces, named after Maurice Fréchet, are special topological vector spaces. They are generalizations of Banach spaces. All Banach and Hilbert spaces are Fréchet spaces. Spaces of infinitely differentiable functions are typical examples of Fréchet spaces, many of which are typically not Banach spaces.

In mathematics, the operator norm measures the "size" of certain linear operators by assigning each a real number called its operator norm. Formally, it is a norm defined on the space of bounded linear operators between two given normed vector spaces. Informally, the operator norm of a linear map is the maximum factor by which it "lengthens" vectors.

In mathematics, the uniform boundedness principle or Banach–Steinhaus theorem is one of the fundamental results in functional analysis. Together with the Hahn–Banach theorem and the open mapping theorem, it is considered one of the cornerstones of the field. In its basic form, it asserts that for a family of continuous linear operators whose domain is a Banach space, pointwise boundedness is equivalent to uniform boundedness in operator norm.

In functional analysis and operator theory, a bounded linear operator is a linear transformation between topological vector spaces (TVSs) and that maps bounded subsets of to bounded subsets of If and are normed vector spaces, then is bounded if and only if there exists some such that for all

In functional analysis and related areas of mathematics, locally convex topological vector spaces (LCTVS) or locally convex spaces are examples of topological vector spaces (TVS) that generalize normed spaces. They can be defined as topological vector spaces whose topology is generated by translations of balanced, absorbent, convex sets. Alternatively they can be defined as a vector space with a family of seminorms, and a topology can be defined in terms of that family. Although in general such spaces are not necessarily normable, the existence of a convex local base for the zero vector is strong enough for the Hahn–Banach theorem to hold, yielding a sufficiently rich theory of continuous linear functionals.

In mathematics, a norm is a function from a real or complex vector space to the non-negative real numbers that behaves in certain ways like the distance from the origin: it commutes with scaling, obeys a form of the triangle inequality, and is zero only at the origin. In particular, the Euclidean distance in a Euclidean space is defined by a norm on the associated Euclidean vector space, called the Euclidean norm, the 2-norm, or, sometimes, the magnitude of the vector. This norm can be defined as the square root of the inner product of a vector with itself.

In the field of mathematics, norms are defined for elements within a vector space. Specifically, when the vector space comprises matrices, such norms are referred to as matrix norms. Matrix norms differ from vector norms in that they must also interact with matrix multiplication.

In functional analysis and related areas of mathematics, a sequence space is a vector space whose elements are infinite sequences of real or complex numbers. Equivalently, it is a function space whose elements are functions from the natural numbers to the field K of real or complex numbers. The set of all such functions is naturally identified with the set of all possible infinite sequences with elements in K, and can be turned into a vector space under the operations of pointwise addition of functions and pointwise scalar multiplication. All sequence spaces are linear subspaces of this space. Sequence spaces are typically equipped with a norm, or at least the structure of a topological vector space.

In the field of mathematical analysis, an interpolation space is a space which lies "in between" two other Banach spaces. The main applications are in Sobolev spaces, where spaces of functions that have a noninteger number of derivatives are interpolated from the spaces of functions with integer number of derivatives.

In mathematical analysis, Lorentz spaces, introduced by George G. Lorentz in the 1950s, are generalisations of the more familiar spaces.

In mathematics, , the vector space of bounded sequences with the supremum norm, and , the vector space of essentially bounded measurable functions with the essential supremum norm, are two closely related Banach spaces. In fact the former is a special case of the latter. As a Banach space they are the continuous dual of the Banach spaces of absolutely summable sequences, and of absolutely integrable measurable functions. Pointwise multiplication gives them the structure of a Banach algebra, and in fact they are the standard examples of abelian Von Neumann algebras.

In mathematics, nuclear operators are an important class of linear operators introduced by Alexander Grothendieck in his doctoral dissertation. Nuclear operators are intimately tied to the projective tensor product of two topological vector spaces (TVSs).

In functional analysis and related areas of mathematics, the strong dual space of a topological vector space (TVS) is the continuous dual space of equipped with the strong (dual) topology or the topology of uniform convergence on bounded subsets of where this topology is denoted by or The coarsest polar topology is called weak topology. The strong dual space plays such an important role in modern functional analysis, that the continuous dual space is usually assumed to have the strong dual topology unless indicated otherwise. To emphasize that the continuous dual space, has the strong dual topology, or may be written.

This is a glossary for the terminology in a mathematical field of functional analysis.

References