Spline wavelet

Last updated
Animation showing the compactly supported cardinal B-spline wavelets of orders 1, 2, 3, 4 and 5. Animation showing images of compactly supported B spline wavelets.gif
Animation showing the compactly supported cardinal B-spline wavelets of orders 1, 2, 3, 4 and 5.

In the mathematical theory of wavelets, a spline wavelet is a wavelet constructed using a spline function. [1] There are different types of spline wavelets. The interpolatory spline wavelets introduced by C.K. Chui and J.Z. Wang are based on a certain spline interpolation formula. [2] Though these wavelets are orthogonal, they do not have compact supports. There is a certain class of wavelets, unique in some sense, constructed using B-splines and having compact supports. Even though these wavelets are not orthogonal they have some special properties that have made them quite popular. [3] The terminology spline wavelet is sometimes used to refer to the wavelets in this class of spline wavelets. These special wavelets are also called B-spline wavelets and cardinal B-spline wavelets. [4] The Battle-Lemarie wavelets are also wavelets constructed using spline functions. [5]

Contents

Cardinal B-splines

Let n be a fixed non-negative integer. Let Cn denote the set of all real-valued functions defined over the set of real numbers such that each function in the set as well its first n derivatives are continuous everywhere. A bi-infinite sequence . . . x−2, x−1, x0, x1, x2, . . . such that xr < xr+1 for all r and such that xr approaches ±∞ as r approaches ±∞ is said to define a set of knots. A spline of order n with a set of knots {xr} is a function S(x) in Cn such that, for each r, the restriction of S(x) to the interval [xr, xr+1) coincides with a polynomial with real coefficients of degree at most n in x.

If the separation xr+1 - xr, where r is any integer, between the successive knots in the set of knots is a constant, the spline is called a cardinal spline. The set of integers Z = {. . ., -2, -1, 0, 1, 2, . . .} is a standard choice for the set of knots of a cardinal spline. Unless otherwise specified, it is generally assumed that the set of knots is the set of integers.

A cardinal B-spline is a special type of cardinal spline. For any positive integer m the cardinal B-spline of order m, denoted by Nm(x), is defined recursively as follows.

, for .

Concrete expressions for the cardinal B-splines of all orders up to 5 and their graphs are given later in this article.

Properties of the cardinal B-splines

Elementary properties

  1. The support of is the closed interval .
  2. The function is non-negative, that is, for .
  3. for all .
  4. The cardinal B-splines of orders m and m-1 are related by the identity: .
  5. The function is symmetrical about , that is, .
  6. The derivative of is given by .

Two-scale relation

The cardinal B-spline of order m satisfies the following two-scale relation:

.

Riesz property

The cardinal B-spline of order m satisfies the following property, known as the Riesz property: There exists two positive real numbers and such that for any square summable two-sided sequence and for any x,

where is the norm in the ℓ2-space.

Cardinal B-splines of small orders

The cardinal B-splines are defined recursively starting from the B-spline of order 1, namely , which takes the value 1 in the interval [0, 1) and 0 elsewhere. Computer algebra systems may have to be employed to obtain concrete expressions for higher order cardinal B-splines. The concrete expressions for cardinal B-splines of all orders up to 6 are given below. The graphs of cardinal B-splines of orders up to 4 are also exhibited. In the images, the graphs of the terms contributing to the corresponding two-scale relations are also shown. The two dots in each image indicate the extremities of the interval supporting the B-spline.

Constant B-spline

The B-spline of order 1, namely , is the constant B-spline. It is defined by

The two-scale relation for this B-spline is

Constant B-spline
BSplineOfOrder1.png
TwoScaleRelationForBSplineOfOrder1.png

Linear B-spline

The B-spline of order 2, namely , is the linear B-spline. It is given by

The two-scale relation for this wavelet is

Linear B-spline
CardinalBSplineOfOrder2.png
TwoScaleRelationForCardinalBSplineOfOrder2.png

Quadratic B-spline

The B-spline of order 3, namely , is the quadratic B-spline. It is given by

The two-scale relation for this wavelet is

Quadratic B-spline
CardinalBSplineOfOrder3.png
TwoScaleRelationForCardinalBSplineOfOrder3.png

Cubic B-spline

The cubic B-spline is the cardinal B-spline of order 4, denoted by . It is given by the following expressions:

The two-scale relation for the cubic B-spline is

Cubic B-spline
CardinalBSplineOfOrder4.png
TwoScaleRelationForCardinalBSplineOfOrder4 fixed.png

Bi-quadratic B-spline

The bi-quadratic B-spline is the cardinal B-spline of order 5 denoted by . It is given by

The two-scale relation is

Quintic B-spline

The quintic B-spline is the cardinal B-spline of order 6 denoted by . It is given by

Multi-resolution analysis generated by cardinal B-splines

The cardinal B-spline of order m generates a multi-resolution analysis. In fact, from the elementary properties of these functions enunciated above, it follows that the function is square integrable and is an element of the space of square integrable functions. To set up the multi-resolution analysis the following notations used.

  • For any integers , define the function .
  • For each integer , define the subspace of as the closure of the linear span of the set .

That these define a multi-resolution analysis follows from the following:

  1. The spaces satisfy the property: .
  2. The closure in of the union of all the subspaces is the whole space .
  3. The intersection of all the subspaces is the singleton set containing only the zero function.
  4. For each integer the set is an unconditional basis for . (A sequence {xn} in a Banach space X is an unconditional basis for the space X if every permutation of the sequence {xn} is also a basis for the same space X. [6] )

Wavelets from cardinal B-splines

Let m be a fixed positive integer and be the cardinal B-spline of order m. A function in is a basic wavelet relative to the cardinal B-spline function if the closure in of the linear span of the set (this closure is denoted by ) is the orthogonal complement of in . The subscript m in is used to indicate that is a basic wavelet relative the cardinal B-spline of order m. There is no unique basic wavelet relative to the cardinal B-spline . Some of these are discussed in the following sections.

Wavelets relative to cardinal B-splines using fundamental interpolatory splines

Fundamental interpolatory spline

Definitions

Let m be a fixed positive integer and let be the cardinal B-spline of order m. Given a sequence of real numbers, the problem of finding a sequence of real numbers such that

for all ,

is known as the cardinal spline interpolation problem. The special case of this problem where the sequence is the sequence , where is the Kronecker delta function defined by

,

is the fundamental cardinal spline interpolation problem. The solution of the problem yields the fundamental cardinal interpolatory spline of order m. This spline is denoted by and is given by

where the sequence is now the solution of the following system of equations:

Procedure to find the fundamental cardinal interpolatory spline

The fundamental cardinal interpolatory spline can be determined using Z-transforms. Using the following notations

it can be seen from the equations defining the sequence that

from which we get

.

This can be used to obtain concrete expressions for .

Example

As a concrete example, the case may be investigated. The definition of implies that

The only nonzero values of are given by and the corresponding values are

Thus reduces to

This yields the following expression for .

Splitting this expression into partial fractions and expanding each term in powers of z in an annular region the values of can be computed. These values are then substituted in the expression for to yield

Wavelet using fundamental interpolatory spline

For a positive integer m, the function defined by

is a basic wavelet relative to the cardinal B-spline of order . The subscript I in is used to indicate that it is based in the interpolatory spline formula. This basic wavelet is not compactly supported.

Example

The wavelet of order 2 using interpolatory spline is given by

The expression for now yields the following formula:

Now, using the expression for the derivative of in terms of the function can be put in the following form:

The following piecewise linear function is the approximation to obtained by taking the sum of the terms corresponding to in the infinite series expression for .

Two-scale relation

The two-scale relation for the wavelet function is given by

where

Compactly supported B-spline wavelets

The spline wavelets generated using the interpolatory wavelets are not compactly supported. Compactly supported B-spline wavelets were discovered by Charles K. Chui and Jian-zhong Wang and published in 1991. [3] [7] The compactly supported B-spline wavelet relative to the cardinal B-spline of order m discovered by Chui and Wong and denoted by , has as its support the interval . These wavelets are essentially unique in a certain sense explained below.

Definition

The compactly supported B-spline wavelet of order m is given by

This is an m-th order spline. As a special case, the compactly supported B-spline wavelet of order 1 is

which is the well-known Haar wavelet.

Properties

  1. The support of is the closed interval .
  2. The wavelet is the unique wavelet with minimum support in the following sense: If generates and has support not exceeding in length then for some nonzero constant and for some integer . [8]
  3. is symmetric for even m and antisymmetric for odd m.

Two-scale relation

satisfies the two-scale relation:

where .

Decomposition relation

The decomposition relation for the compactly supported B-spline wavelet has the following form:

where the coefficients and are given by

Here the sequence is the sequence of coefficients in the fundamental interpolatoty cardinal spline wavelet of order m.

Compactly supported B-spline wavelets of small orders

Compactly supported B-spline wavelet of order 1

The two-scale relation for the compactly supported B-spline wavelet of order 1 is

The closed form expression for compactly supported B-spline wavelet of order 1 is

Compactly supported B-spline wavelet of order 2

The two-scale relation for the compactly supported B-spline wavelet of order 2 is

The closed form expression for compactly supported B-spline wavelet of order 2 is

Compactly supported B-spline wavelet of order 3

The two-scale relation for the compactly supported B-spline wavelet of order 3 is

The closed form expression for compactly supported B-spline wavelet of order 3 is

Compactly supported B-spline wavelet of order 4

The two-scale relation for the compactly supported B-spline wavelet of order 4 is

The closed form expression for compactly supported B-spline wavelet of order 4 is

Compactly supported B-spline wavelet of order 5

The two-scale relation for the compactly supported B-spline wavelet of order 5 is

The closed form expression for compactly supported B-spline wavelet of order 5 is

Images of compactly supported B-spline wavelets

CardinalBSplineWaveletOfOrder1.png
CardinalBSplineWaveletOfOrder2.png
B-spline wavelet of order 1B-spline wavelet of order 2
CardinalBSplineWaveletOfOrder3.png
CardinalBSplineWaveletOfOrder4.png
CardinalBSplineWaveletOfOrder5.png
B-spline wavelet of order 3B-spline wavelet of order 4B-spline wavelet of order 5

Battle-Lemarie wavelets

The Battle-Lemarie wavelets form a class of orthonormal wavelets constructed using the class of cardinal B-splines. The expressions for these wavelets are given in the frequency domain; that is, they are defined by specifying their Fourier transforms. The Fourier transform of a function of t, say, , is denoted by .

Definition

Let m be a positive integer and let be the cardinal B-spline of order m. The Fourier transform of is . The scaling function for the m-th order Battle-Lemarie wavelet is that function whose Fourier transform is

The m-th order Battle-Lemarie wavelet is the function whose Fourier transform is

Related Research Articles

<span class="mw-page-title-main">Uncertainty principle</span> Foundational principle in quantum physics

In quantum mechanics, the uncertainty principle is any of a variety of mathematical inequalities asserting a fundamental limit to the product of the accuracy of certain related pairs of measurements on a quantum system, such as position, x, and momentum, p. Such paired-variables are known as complementary variables or canonically conjugate variables.

<span class="mw-page-title-main">Wavelet</span> Function for integral Fourier-like transform

A wavelet is a wave-like oscillation with an amplitude that begins at zero, increases or decreases, and then returns to zero one or more times. Wavelets are termed a "brief oscillation". A taxonomy of wavelets has been established, based on the number and direction of its pulses. Wavelets are imbued with specific properties that make them useful for signal processing.

<span class="mw-page-title-main">Haar wavelet</span> First known wavelet basis

In mathematics, the Haar wavelet is a sequence of rescaled "square-shaped" functions which together form a wavelet family or basis. Wavelet analysis is similar to Fourier analysis in that it allows a target function over an interval to be represented in terms of an orthonormal basis. The Haar sequence is now recognised as the first known wavelet basis and is extensively used as a teaching example.

<span class="mw-page-title-main">Polygamma function</span> Meromorphic function

In mathematics, the polygamma function of order m is a meromorphic function on the complex numbers defined as the (m + 1)th derivative of the logarithm of the gamma function:

<span class="mw-page-title-main">Digamma function</span> Mathematical function

In mathematics, the digamma function is defined as the logarithmic derivative of the gamma function:

<span class="mw-page-title-main">Continuous wavelet transform</span> Integral transform

In mathematics, the continuous wavelet transform (CWT) is a formal tool that provides an overcomplete representation of a signal by letting the translation and scale parameter of the wavelets vary continuously.

<span class="mw-page-title-main">Wavelet transform</span> Mathematical technique used in data compression and analysis

In mathematics, a wavelet series is a representation of a square-integrable function by a certain orthonormal series generated by a wavelet. This article provides a formal, mathematical definition of an orthonormal wavelet and of the integral wavelet transform.

An orthogonal wavelet is a wavelet whose associated wavelet transform is orthogonal. That is, the inverse wavelet transform is the adjoint of the wavelet transform. If this condition is weakened one may end up with biorthogonal wavelets.

In mathematics, a dual wavelet is the dual to a wavelet. In general, the wavelet series generated by a square-integrable function will have a dual series, in the sense of the Riesz representation theorem. However, the dual series is not itself in general representable by a square-integrable function.

<span class="mw-page-title-main">Chebyshev function</span>

In mathematics, the Chebyshev function is either a scalarising function (Tchebycheff function) or one of two related functions. The first Chebyshev functionϑ  (x) or θ (x) is given by

Continuous wavelets of compact support alpha can be built, which are related to the beta distribution. The process is derived from probability distributions using blur derivative. These new wavelets have just one cycle, so they are termed unicycle wavelets. They can be viewed as a soft variety of Haar wavelets whose shape is fine-tuned by two parameters and . Closed-form expressions for beta wavelets and scale functions as well as their spectra are derived. Their importance is due to the Central Limit Theorem by Gnedenko and Kolmogorov applied for compactly supported signals.

<span class="mw-page-title-main">Generalized Pareto distribution</span> Family of probability distributions often used to model tails or extreme values

In statistics, the generalized Pareto distribution (GPD) is a family of continuous probability distributions. It is often used to model the tails of another distribution. It is specified by three parameters: location , scale , and shape . Sometimes it is specified by only scale and shape and sometimes only by its shape parameter. Some references give the shape parameter as .

In functional analysis, the Shannon wavelet is a decomposition that is defined by signal analysis by ideal bandpass filters. Shannon wavelet may be either of real or complex type.

In mathematical analysis, and especially in real, harmonic analysis and functional analysis, an Orlicz space is a type of function space which generalizes the Lp spaces. Like the Lp spaces, they are Banach spaces. The spaces are named for Władysław Orlicz, who was the first to define them in 1932.

Overcompleteness is a concept from linear algebra that is widely used in mathematics, computer science, engineering, and statistics. It was introduced by R. J. Duffin and A. C. Schaeffer in 1952.

Coherent states have been introduced in a physical context, first as quasi-classical states in quantum mechanics, then as the backbone of quantum optics and they are described in that spirit in the article Coherent states. However, they have generated a huge variety of generalizations, which have led to a tremendous amount of literature in mathematical physics. In this article, we sketch the main directions of research on this line. For further details, we refer to several existing surveys.

In applied mathematical analysis, shearlets are a multiscale framework which allows efficient encoding of anisotropic features in multivariate problem classes. Originally, shearlets were introduced in 2006 for the analysis and sparse approximation of functions . They are a natural extension of wavelets, to accommodate the fact that multivariate functions are typically governed by anisotropic features such as edges in images, since wavelets, as isotropic objects, are not capable of capturing such phenomena.

In mathematics, in functional analysis, several different wavelets are known by the name Poisson wavelet. In one context, the term "Poisson wavelet" is used to denote a family of wavelets labeled by the set of positive integers, the members of which are associated with the Poisson probability distribution. These wavelets were first defined and studied by Karlene A. Kosanovich, Allan R. Moser and Michael J. Piovoso in 1995–96. In another context, the term refers to a certain wavelet which involves a form of the Poisson integral kernel. In still another context, the terminology is used to describe a family of complex wavelets indexed by positive integers which are connected with the derivatives of the Poisson integral kernel.

Maximal entropy random walk (MERW) is a popular type of biased random walk on a graph, in which transition probabilities are chosen accordingly to the principle of maximum entropy, which says that the probability distribution which best represents the current state of knowledge is the one with largest entropy. While standard random walk chooses for every vertex uniform probability distribution among its outgoing edges, locally maximizing entropy rate, MERW maximizes it globally by assuming uniform probability distribution among all paths in a given graph.

The Bernoulli polynomials of the second kindψn(x), also known as the Fontana-Bessel polynomials, are the polynomials defined by the following generating function:

References

  1. Michael Unser (1997). Aldroubi, Akram; Laine, Andrew F.; Unser, Michael A. (eds.). "Ten good reasons for using spline wavelets" (PDF). Proc. SPIE Vol. 3169, Wavelets Applications in Signal and Image Processing V. Wavelet Applications in Signal and Image Processing V. 3169: 422–431. Bibcode:1997SPIE.3169..422U. doi:10.1117/12.292801. S2CID   12705597 . Retrieved 21 December 2014.
  2. Chui, Charles K, and Jian-zhong Wang (1991). "A cardinal spline approach to wavelets" (PDF). Proceedings of the American Mathematical Society. 113 (3): 785–793. doi: 10.2307/2048616 . JSTOR   2048616 . Retrieved 22 January 2015.{{cite journal}}: CS1 maint: multiple names: authors list (link)
  3. 1 2 Charles K. Chui and Jian-Zhong Wang (April 1992). "On Compactly Supported Spline Wavelets and a Duality Principle" (PDF). Transactions of the American Mathematical Society. 330 (2): 903–915. doi: 10.1090/s0002-9947-1992-1076613-3 . Retrieved 21 December 2014.
  4. Charles K Chui (1992). An Introduction to Wavelets. Academic Press. p. 177.
  5. Ingrid Daubechies (1992). Ten Lectures on Wavelets . Philadelphia: Society for Industrial and Applied Mathematics. pp.  146–153. ISBN   9780898712742.
  6. Christopher Heil (2011). A Basis Theory Primer . Birkhauser. pp.  177–188. ISBN   9780817646868.
  7. Charles K Chui (1992). An Introduction to Wavelets. Academic Press. p. 249.
  8. Charles K Chui (1992). An Introduction to Wavelets. Academic Press. p. 184.

Further reading