Neumann series

Last updated September 25, 2023

A Neumann series is a mathematical series of the form

The series is named after the mathematician Carl Neumann, who used it in 1877 in the context of potential theory. The Neumann series is used in functional analysis. It forms the basis of the Liouville-Neumann series, which is used to solve Fredholm integral equations. It is also important when studying the spectrum of bounded operators.

Properties

Suppose that $T$ is a bounded linear operator on the normed vector space $X$ . If the Neumann series converges in the operator norm, then ${\text{Id}}-T$ is invertible and its inverse is the series:

(\mathrm {Id} -T)^{-1}=\sum _{k=0}^{\infty }T^{k}

,

where $\mathrm {Id}$ is the identity operator in $X$ . To see why, consider the partial sums

S_{n}:=\sum _{k=0}^{n}T^{k}

.

Then we have

\lim _{n\rightarrow \infty }(\mathrm {Id} -T)S_{n}=\lim _{n\rightarrow \infty }\left(\sum _{k=0}^{n}T^{k}-\sum _{k=0}^{n}T^{k+1}\right)=\lim _{n\rightarrow \infty }\left(\mathrm {Id} -T^{n+1}\right)=\mathrm {Id} .

This result on operators is analogous to geometric series in $\mathbb {R}$ , in which we find that:

(1-x)\cdot (1+x+x^{2}+\cdots +x^{n-1}+x^{n})=1-x^{n+1},

1+x+x^{2}+\cdots ={\frac {1}{1-x}}.

One case in which convergence is guaranteed is when $X$ is a Banach space and $|T|<1$ in the operator norm or $\sum |T^{n}|$ is convergent. However, there are also results which give weaker conditions under which the series converges.

Example

Let $C\in \mathbb {R} ^{3\times 3}$ be given by:

{\begin{pmatrix}0&{\frac {1}{2}}&{\frac {1}{4}}\\{\frac {5}{7}}&0&{\frac {1}{7}}\\{\frac {3}{10}}&{\frac {3}{5}}&0\end{pmatrix}}.

We need to show that C is smaller than unity in some norm. Therefore, we calculate:

{\begin{aligned}||C||_{\infty }&=\max _{i}\sum _{j}|c_{ij}|=\max \left\lbrace {\frac {3}{4}},{\frac {6}{7}},{\frac {9}{10}}\right\rbrace ={\frac {9}{10}}<1.\end{aligned}}

Thus, we know from the statement above that $(I-C)^{-1}$ exists.

Approximate matrix inversion

A truncated Neumann series can be used for approximate matrix inversion. To approximate the inverse of an invertible matrix $\mathbf {A}$ , we can assign the linear operator as:

T(\mathbf {x} )=(\mathbf {I} -\mathbf {A} )\mathbf {x}

where $\mathbf {I}$ is the identity matrix. If the norm condition on $T$ is satisfied, then truncating the series at $n$ , we get:

\mathbf {A} ^{-1}\approx \sum _{i=0}^{n}(\mathbf {I} -\mathbf {A} )^{i}

The set of invertible operators is open

A corollary is that the set of invertible operators between two Banach spaces $B$ and $B'$ is open in the topology induced by the operator norm. Indeed, let $S:B\to B'$ be an invertible operator and let $T:B\to B'$ be another operator. If $|S-T|<|S^{-1}|^{-1}$ , then $T$ is also invertible. Since $|\mathrm {Id} -S^{-1}T|<1$ , the Neumann series $\sum (\mathrm {Id} -S^{-1}T)^{k}$ is convergent. Therefore, we have

T^{-1}S=(\mathrm {Id} -(\mathrm {Id} -S^{-1}T))^{-1}=\sum _{k=0}^{\infty }(\mathrm {Id} -S^{-1}T)^{k}

Taking the norms, we get

|T^{-1}S|\leq {\frac {1}{1-|\mathrm {Id} -(S^{-1}T)|}}

The norm of $T^{-1}$ can be bounded by

|T^{-1}|\leq {\tfrac {1}{1-q}}|S^{-1}|\quad {\text{where}}\quad q=|S-T|\,|S^{-1}|.

Applications

The Neumann series has been used for linear data detection in massive multiuser multiple-input multiple-output (MIMO) wireless systems. Using a truncated Neumann series avoids computation of an explicit matrix inverse, which reduces the complexity of linear data detection from cubic to square.^[1]

Another application is the theory of Propagation graphs which takes advantage of Neumann series to derive closed form expression for the transfer function.

Related Research Articles

In mathematics, an operator is generally a mapping or function that acts on elements of a space to produce elements of another space. There is no general definition of an operator, but the term is often used in place of function when the domain is a set of functions or other structured objects. Also, the domain of an operator is often difficult to characterize explicitly, and may be extended so as to act on related objects. See Operator (physics) for other examples.

In mathematical physics, the Dirac delta distribution, also known as the unit impulse, is a generalized function or distribution over the real numbers, whose value is zero everywhere except at zero, and whose integral over the entire real line is equal to one.

<span class="mw-page-title-main">Fourier series</span> Decomposition of periodic functions into sums of simpler sinusoidal forms

A Fourier series is an expansion of a periodic function into a sum of trigonometric functions. The Fourier series is an example of a trigonometric series, but not all trigonometric series are Fourier series. By expressing a function as a sum of sines and cosines, many problems involving the function become easier to analyze because trigonometric functions are well understood. For example, Fourier series were first used by Joseph Fourier to find solutions to the heat equation. This application is possible because the derivatives of trigonometric functions fall into simple patterns. Fourier series cannot be used to approximate arbitrary functions, because most functions have infinitely many terms in their Fourier series, and the series do not always converge. Well-behaved functions, for example smooth functions, have Fourier series that converge to the original function. The coefficients of the Fourier series are determined by integrals of the function multiplied by trigonometric functions, described in Common forms of the Fourier series below.

In the mathematical field of real analysis, the monotone convergence theorem is any of a number of related theorems proving the convergence of monotonic sequences that are also bounded. Informally, the theorems state that if a sequence is increasing and bounded above by a supremum, then the sequence will converge to the supremum; in the same way, if a sequence is decreasing and is bounded below by an infimum, it will converge to the infimum.

In linear algebra, an $n$ -by- $n$ square matrix $A$ is called invertible, if there exists an $n$ -by- $n$ square matrix $B$ such that

In mathematics, Fredholm operators are certain operators that arise in the Fredholm theory of integral equations. They are named in honour of Erik Ivar Fredholm. By definition, a Fredholm operator is a bounded linear operator T : X → Y between two Banach spaces with finite-dimensional kernel $and finite-dimensional (algebraic) cokernel, and with closed range . The last condition is actually redundant.$

In physics, an operator is a function over a space of physical states onto another space of physical states. The simplest example of the utility of operators is the study of symmetry. Because of this, they are useful tools in classical mechanics. Operators are even more important in quantum mechanics, where they form an intrinsic part of the formulation of the theory.

In complex analysis, the Hardy spacesH^p are certain spaces of holomorphic functions on the unit disk or upper half plane. They were introduced by Frigyes Riesz, who named them after G. H. Hardy, because of the paper. In real analysis Hardy spaces are certain spaces of distributions on the real line, which are boundary values of the holomorphic functions of the complex Hardy spaces, and are related to the L^p spaces of functional analysis. For 1 ≤ p < ∞ these real Hardy spaces H^p are certain subsets of L^p, while for p < 1 the L^p spaces have some undesirable properties, and the Hardy spaces are much better behaved.

In mathematics, the spectral radius of a square matrix is the maximum of the absolute values of its eigenvalues. More generally, the spectral radius of a bounded linear operator is the supremum of the absolute values of the elements of its spectrum. The spectral radius is often denoted by $ρ(\cdot)$ .

In physics, the S-matrix or scattering matrix relates the initial state and the final state of a physical system undergoing a scattering process. It is used in quantum mechanics, scattering theory and quantum field theory (QFT).

In mathematics, the matrix exponential is a matrix function on square matrices analogous to the ordinary exponential function. It is used to solve systems of linear differential equations. In the theory of Lie groups, the matrix exponential gives the exponential map between a matrix Lie algebra and the corresponding Lie group.

In the theory of stochastic processes, the Karhunen–Loève theorem, also known as the Kosambi–Karhunen–Loève theorem states that a stochastic process can be represented as an infinite linear combination of orthogonal functions, analogous to a Fourier series representation of a function on a bounded interval. The transformation is also known as Hotelling transform and eigenvector transform, and is closely related to principal component analysis (PCA) technique widely used in image processing and in data analysis in many fields.

In mathematics, the Riesz–Thorin theorem, often referred to as the Riesz–Thorin interpolation theorem or the Riesz–Thorin convexity theorem, is a result about interpolation of operators. It is named after Marcel Riesz and his student G. Olof Thorin.

In control theory, the discrete Lyapunov equation is of the form

In mathematics, the Helmholtz equation is the eigenvalue problem for the Laplace operator. It corresponds to the linear partial differential equation

In quantum field theory, the Lehmann–Symanzik–Zimmerman (LSZ) reduction formula is a method to calculate S-matrix elements from the time-ordered correlation functions of a quantum field theory. It is a step of the path that starts from the Lagrangian of some quantum field theory and leads to prediction of measurable quantities. It is named after the three German physicists Harry Lehmann, Kurt Symanzik and Wolfhart Zimmermann.

In many-body theory, the term Green's function is sometimes used interchangeably with correlation function, but refers specifically to correlators of field operators or creation and annihilation operators.

In mathematics, Hilbert spaces allow the methods of linear algebra and calculus to be generalized from (finite-dimensional) Euclidean vector spaces to spaces that may be infinite-dimensional. Hilbert spaces arise naturally and frequently in mathematics and physics, typically as function spaces. Formally, a Hilbert space is a vector space equipped with an inner product that induces a distance function for which the space is a complete metric space.

In multivariable calculus, an iterated limit is a limit of a sequence or a limit of a function in the form

Quantum stochastic calculus is a generalization of stochastic calculus to noncommuting variables. The tools provided by quantum stochastic calculus are of great use for modeling the random evolution of systems undergoing measurement, as in quantum trajectories. Just as the Lindblad master equation provides a quantum generalization to the Fokker–Planck equation, quantum stochastic calculus allows for the derivation of quantum stochastic differential equations (QSDE) that are analogous to classical Langevin equations.

References

↑ Wu, M.; Yin, B.; Vosoughi, A.; Studer, C.; Cavallaro, J. R.; Dick, C. (May 2013). "Approximate matrix inversion for high-throughput data detection in the large-scale MIMO uplink". 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013). pp. 2155–2158. doi:10.1109/ISCAS.2013.6572301. hdl: 1911/75011 . ISBN 978-1-4673-5762-3. S2CID 389966.

Werner, Dirk (2005). Funktionalanalysis (in German). Springer Verlag. ISBN 3-540-43586-7.

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[1] Wu, M.; Yin, B.; Vosoughi, A.; Studer, C.; Cavallaro, J. R.; Dick, C. (May 2013). "Approximate matrix inversion for high-throughput data detection in the large-scale MIMO uplink". 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013). pp. 2155–2158. doi:10.1109/ISCAS.2013.6572301. hdl: 1911/75011 . ISBN 978-1-4673-5762-3. S2CID 389966.

[1]