Order of integration (calculus)

For the summary statistic in time series, see Order of integration.

In calculus, interchange of the order of integration is a methodology that transforms iterated integrals (or multiple integrals through the use of Fubini's theorem) of functions into other, hopefully simpler, integrals by changing the order in which the integrations are performed. In some cases, the order of integration can be validly interchanged; in others it cannot.

Problem statement

The problem for examination is evaluation of an integral of the form

${\displaystyle \iint _{D}\ f(x,y)\ dx\,dy,}$

where D is some two-dimensional area in the xy–plane. For some functions f straightforward integration is feasible, but where that is not true, the integral can sometimes be reduced to simpler form by changing the order of integration. The difficulty with this interchange is determining the change in description of the domain D.

The method also is applicable to other multiple integrals. ^{[1] [2]}

Sometimes, even though a full evaluation is difficult, or perhaps requires a numerical integration, a double integral can be reduced to a single integration, as illustrated next. Reduction to a single integration makes a numerical evaluation much easier and more efficient.

Relation to integration by parts

Figure 1: Integration over the triangular area can be done using vertical or horizontal strips as the first step. This is an overhead view, looking down the z-axis onto the xy-plane. The sloped line is the curve y = x.

Consider the iterated integral

${\displaystyle \int _{a}^{z}\,\int _{a}^{x}\,h(y)\,dy\,dx,}$

In this expression, the second integral is calculated first with respect to y and x is held constant—a strip of width dx is integrated first over the y-direction (a strip of width dx in the x direction is integrated with respect to the y variable across the y direction), adding up an infinite amount of rectangles of width dy along the y-axis. This forms a three dimensional slice dx wide along the x-axis, from y=a to y=x along the y-axis, and in the z direction z=h(y). Notice that if the thickness dx is infinitesimal, x varies only infinitesimally on the slice. We can assume that x is constant. ^[3] This integration is as shown in the left panel of Figure 1, but is inconvenient especially when the function h(y) is not easily integrated. The integral can be reduced to a single integration by reversing the order of integration as shown in the right panel of the figure. To accomplish this interchange of variables, the strip of width dy is first integrated from the line x = y to the limit x = z, and then the result is integrated from y = a to y = z, resulting in:

${\displaystyle \int _{a}^{z}\int _{a}^{x}h(y)\ dy\ dx=\int _{a}^{z}h(y)\ dy\ \int _{y}^{z}dx=\int _{a}^{z}\left(z-y\right)h(y)\,dy.}$

This result can be seen to be an example of the formula for integration by parts, as stated below: ^[4]

${\displaystyle \int _{a}^{z}f(x)g'(x)\,dx=\left[f(x)g(x)\right]_{a}^{z}-\int _{a}^{z}f'(x)g(x)\,dx}$

Substitute:

${\displaystyle f(x)=\int _{a}^{x}h(y)\,dy~{\text{ and }}~g'(x)=1.}$

Which gives the result.

Principal-value integrals

For application to principal-value integrals, see Whittaker and Watson, ^[5] Gakhov, ^[6] Lu, ^[7] or Zwillinger. ^[8] See also the discussion of the Poincaré-Bertrand transformation in Obolashvili. ^[9] An example where the order of integration cannot be exchanged is given by Kanwal: ^[10]

${\displaystyle {\frac {1}{(2\pi i)^{2}}}\int _{L}^{*}{\frac {d{\tau }_{1}}{{\tau }_{1}-t}}\ \int _{L}^{*}\ g(\tau ){\frac {d\tau }{\tau -\tau _{1}}}={\frac {1}{4}}g(t)\ ,}$

while:

${\displaystyle {\frac {1}{(2\pi i)^{2}}}\int _{L}^{*}g(\tau )\ d\tau \left(\int _{L}^{*}{\frac {d\tau _{1}}{\left(\tau _{1}-t\right)\left(\tau -\tau _{1}\right)}}\right)=0\ .}$

The second form is evaluated using a partial fraction expansion and an evaluation using the Sokhotski–Plemelj formula: ^[11]

${\displaystyle \int _{L}^{*}{\frac {d\tau _{1}}{\tau _{1}-t}}=\int _{L}^{*}{\frac {d\tau _{1}}{\tau _{1}-t}}=\pi \ i\ .}$

The notation ${\displaystyle \int _{L}^{*}}$ indicates a Cauchy principal value. See Kanwal. ^[10]

Basic theorems

A discussion of the basis for reversing the order of integration is found in the book Fourier Analysis by T.W. Körner. ^[12] He introduces his discussion with an example where interchange of integration leads to two different answers because the conditions of Theorem II below are not satisfied. Here is the example:

${\displaystyle \int _{1}^{\infty }{\frac {x^{2}-y^{2}}{\left(x^{2}+y^{2}\right)^{2}}}\ dy=\left[{\frac {y}{x^{2}+y^{2}}}\right]_{1}^{\infty }=-{\frac {1}{1+x^{2}}}\ \left[x\geq 1\right]\ .}$

${\displaystyle \int _{1}^{\infty }\left(\int _{1}^{\infty }{\frac {x^{2}-y^{2}}{\left(x^{2}+y^{2}\right)^{2}}}\ dy\right)\ dx=-{\frac {\pi }{4}}\ .}$

${\displaystyle \int _{1}^{\infty }\left(\int _{1}^{\infty }{\frac {x^{2}-y^{2}}{\left(x^{2}+y^{2}\right)^{2}}}\ dx\right)\ dy={\frac {\pi }{4}}\ .}$

Two basic theorems governing admissibility of the interchange are quoted below from Chaudhry and Zubair: ^[13]

Theorem I — Let f(x, y) be a continuous function of constant sign defined for a ≤ x < ∞, c ≤ y < ∞, and let the integrals

${\displaystyle J(y):=\int _{a}^{\infty }f(x,\ y)\,dx}$           and           ${\displaystyle J^{*}(x)=\int _{c}^{\infty }f(x,\ y)\,dy}$

regarded as functions of the corresponding parameter be, respectively, continuous for c ≤ y < ∞, a ≤ x < ∞. Then if at least one of the iterated integrals

${\displaystyle \int _{c}^{\infty }\left(\int _{a}^{\infty }\ f(x,\ y)dx\right)dy}$           and           ${\displaystyle \int _{a}^{\infty }\ \left(\int _{c}^{\infty }\ f(x,\ y)dy\right)dx}$

converges, the other integral also converges and their values coincide.

Theorem II — Let f(x, y) be continuous for a ≤ x < ∞, c ≤ y < ∞, and let the integrals

${\displaystyle J(y):=\int _{a}^{\infty }f(x,\ y)\,dx}$           and           ${\displaystyle J^{*}(x)=\int _{c}^{\infty }f(x,\ y)\,dy}$

be respectively, uniformly convergent on every finite interval c ≤ y < C and on every finite interval a ≤ x < A. Then if at least one of the iterated integrals

${\displaystyle \int _{c}^{\infty }\left(\int _{a}^{\infty }|f(x,\ y)|dx\right)dy}$           and           ${\displaystyle \int _{a}^{\infty }\ \left(\int _{c}^{\infty }|f(x,\ y)|dy\right)dx}$

converges, the iterated integrals

${\displaystyle \int _{c}^{\infty }\left(\int _{a}^{\infty }f(x,\ y)dx\right)dy}$           and           ${\displaystyle \int _{a}^{\infty }\left(\int _{c}^{\infty }f(x,\ y)dy\right)dx}$

also converge and their values are equal.

The most important theorem for the applications is quoted from Protter and Morrey: ^[14]

Theorem — Suppose F is a region given by ${\displaystyle F=\left\{(x,\ y):a\leq x\leq b,p(x)\leq y\leq q(x)\right\}\,}$  where p and q are continuous and p(x) ≤ q(x) for a ≤ x ≤ b. Suppose that f(x, y) is continuous on F. Then

${\displaystyle \iint _{F}f(x,y)\,dA=\int _{a}^{b}\int _{p(x)}^{q(x)}f(x,\ y)\,dy\ dx.}$

The corresponding result holds if the closed region F has the representation ${\displaystyle F=\left\{(x,\ y):c\leq y\leq d,\ r(y)\leq x\leq s(y)\right\}}$  where r(y) ≤ s(y) for c ≤ y ≤ d.  In such a case,

${\displaystyle \iint _{F}f(x,\ y)dA=\int _{c}^{d}\int _{r(y)}^{s(y)}f(x,\ y)\,dx\ dy\ .}$

In other words, both iterated integrals, when computable, are equal to the double integral and therefore equal to each other.

See also

• Fubini's theorem

References and notes

1. Seán Dineen (2001). Multivariate Calculus and Geometry. Springer. p. 162. ISBN   1-85233-472-X.
2. Richard Courant & Fritz John (2000). Introduction to Calculus and Analysis: Vol. II/1, II/2. Classics in mathematics. Springer. p. 897. ISBN   3-540-66569-2.
3. "Double Integrals". Department of Mathematics, Oregon State University. 1996.
4. The prime " ′ " denotes a derivative in Lagrange's notation.
5. Edmund Taylor Whittaker; George Neville Watson (1927). A Course of Modern Analysis: an introduction to the general theory of infinite processes and of analytic functions, with an account of the principal transcendental functions (4th ed., repr ed.). Cambridge University Press. p. §4.51, p. 75. ISBN   0-521-58807-3.
6. F. D. Gakhov (1990). Boundary Value Problems. Courier Dover Publications. p. 46. ISBN   0-486-66275-6.
7. Jian-Ke Lu (1993). Boundary Value Problems for Analytic Functions. Singapore: World Scientific. p. 44. ISBN   981-02-1020-5.
8. Daniel Zwillinger (1992). Handbook of integration. AK Peters Ltd. p. 61. ISBN   0-86720-293-9.
9. Elena Irodionovna Obolashvili (2003). Higher order partial differential equations in Clifford analysis: effective solutions to problems. Birkhäuser. p. 101. ISBN   0-8176-4286-2.
10. Ram P. Kanwal (1996). Linear Integral Equations: theory and technique (2nd ed.). Boston: Birkhäuser. p. 194. ISBN   0-8176-3940-3.
11. For a discussion of the Sokhotski-Plemelj formula see, for example, Joseph A. Cima, Alec L. Matheson & William T. Ross (2006). The Cauchy Transform. American Mathematical Society. p. 56. ISBN   0-8218-3871-7. or Rainer Kress (1999). Linear integral equations (2nd ed.). Springer. p. Theorem 7.6, p. 101. ISBN   0-387-98700-2.
12. Thomas William Körner (1988). Fourier Analysis. Cambridge University Press. p. Chapters 47 & 48. ISBN   0-521-38991-7.
13. M. Aslam Chaudhry & Syed M. Zubair (2001). On a Class of Incomplete Gamma Functions with Applications. CRC Press. p. Appendix C. ISBN   1-58488-143-7.
14. Murray H. Protter & Charles B. Morrey, Jr. (1985). Intermediate Calculus. Springer. p. 307. ISBN   0-387-96058-9.

External links

• Paul's Online Math Notes: Calculus III
• Good 3D images showing the computation of "Double Integrals" using iterated integrals, the Department of Mathematics at Oregon State University.
• Ron Miech's UCLA Calculus Problems More complex examples of changing the order of integration (see Problems 33, 35, 37, 39, 41 & 43)
• Duane Nykamp's University of Minnesota website