Backward Euler method

In numerical analysis and scientific computing, the backward Euler method (or implicit Euler method) is one of the most basic numerical methods for the solution of ordinary differential equations. It is similar to the (standard) Euler method, but differs in that it is an implicit method. The backward Euler method has error of order one in time.

Description

Consider the ordinary differential equation

${\displaystyle {\frac {\mathrm {d} y}{\mathrm {d} t}}=f(t,y)}$

with initial value ${\displaystyle y(t_{0})=y_{0}.}$ Here the function ${\displaystyle f}$ and the initial data ${\displaystyle t_{0}}$ and ${\displaystyle y_{0}}$ are known; the function ${\displaystyle y}$ depends on the real variable ${\displaystyle t}$ and is unknown. A numerical method produces a sequence ${\displaystyle y_{0},y_{1},y_{2},\ldots }$ such that ${\displaystyle y_{k}}$ approximates ${\displaystyle y(t_{0}+kh)}$, where ${\displaystyle h}$ is called the step size.

The backward Euler method computes the approximations using

${\displaystyle y_{k+1}=y_{k}+hf(t_{k+1},y_{k+1}).}$ ^[1]

This differs from the (forward) Euler method in that the forward method uses ${\displaystyle f(t_{k},y_{k})}$ in place of ${\displaystyle f(t_{k+1},y_{k+1})}$.

The backward Euler method is an implicit method: the new approximation ${\displaystyle y_{k+1}}$ appears on both sides of the equation, and thus the method needs to solve an algebraic equation for the unknown ${\displaystyle y_{k+1}}$. For non-stiff problems, this can be done with fixed-point iteration:

${\displaystyle y_{k+1}^{[0]}=y_{k},\quad y_{k+1}^{[i+1]}=y_{k}+hf(t_{k+1},y_{k+1}^{[i]}).}$

If this sequence converges (within a given tolerance), then the method takes its limit as the new approximation ${\displaystyle y_{k+1}}$. ^[2]

Alternatively, one can use (some modification of) the Newton–Raphson method to solve the algebraic equation.

Derivation

Integrating the differential equation ${\displaystyle {\frac {\mathrm {d} y}{\mathrm {d} t}}=f(t,y)}$ from ${\displaystyle t_{n}}$ to ${\displaystyle t_{n+1}=t_{n}+h}$ yields

${\displaystyle y(t_{n+1})-y(t_{n})=\int _{t_{n}}^{t_{n+1}}f(t,y(t))\,\mathrm {d} t.}$

Now approximate the integral on the right by the right-hand rectangle method (with one rectangle):

${\displaystyle y(t_{n+1})-y(t_{n})\approx hf(t_{n+1},y(t_{n+1})).}$

Finally, use that ${\displaystyle y_{n}}$ is supposed to approximate ${\displaystyle y(t_{n})}$ and the formula for the backward Euler method follows. ^[3]

The same reasoning leads to the (standard) Euler method if the left-hand rectangle rule is used instead of the right-hand one.

Analysis

The pink region outside the disk shows the stability region of the backward Euler method.

The local truncation error (defined as the error made in one step) of the backward Euler Method is ${\displaystyle O(h^{2})}$, using the big O notation. The error at a specific time ${\displaystyle t}$ is ${\displaystyle O(h^{2})}$. It means that this method has order one. In general, a method with ${\displaystyle O(h^{k+1})}$ LTE (local truncation error) is said to be of kth order.

The region of absolute stability for the backward Euler method is the complement in the complex plane of the disk with radius 1 centered at 1, depicted in the figure. ^[4] This includes the whole left half of the complex plane, making it suitable for the solution of stiff equations. ^[5] In fact, the backward Euler method is even L-stable.

The region for a discrete stable system by Backward Euler Method is a circle with radius 0.5 which is located at (0.5, 0) in the z-plane. ^[6]

Extensions and modifications

The backward Euler method is a variant of the (forward) Euler method. Other variants are the semi-implicit Euler method and the exponential Euler method.

The backward Euler method can be seen as a Runge–Kutta method with one stage, described by the Butcher tableau:

${\displaystyle {\begin{array}{c|c}1&1\\\hline &1\\\end{array}}}$

The method can also be seen as a linear multistep method with one step. It is the first method of the family of Adams–Moulton methods, and also of the family of backward differentiation formulas.

See also

• Crank–Nicolson method

Notes

1. Butcher 2003 , p. 57
2. Butcher 2003 , p. 57
3. Butcher 2003 , p. 57
4. Butcher 2003 , p. 70
5. Butcher 2003 , p. 71
6. Wai-Kai Chen, Ed., Analog and VLSI Circuits The Circuits and Filters Handbook, 3rd ed. Chicago, USA: CRC Press, 2009.

References

• Butcher, John C. (2003), Numerical Methods for Ordinary Differential Equations, New York: John Wiley & Sons, ISBN   978-0-471-96758-3 .