Von Neumann stability analysis

Template:Short description In numerical analysis, von Neumann stability analysis (also known as Fourier stability analysis) is a procedure used to check the stability of finite difference schemes as applied to linear partial differential equations. The analysis is based on the Fourier decomposition of numerical error and was developed at Los Alamos National Laboratory after having been briefly described in a 1947 article by British researchers John Crank and Phyllis Nicolson. This method is an example of explicit time integration where the function that defines governing equation is evaluated at the current time. Later, the method was given a more rigorous treatment in an article co-authored by John von Neumann.

Numerical stability

The stability of numerical schemes is closely associated with numerical error. A finite difference scheme is stable if the errors made at one time step of the calculation do not cause the errors to be magnified as the computations are continued. A neutrally stable scheme is one in which errors remain constant as the computations are carried forward. If the errors decay and eventually damp out, the numerical scheme is said to be stable. If, on the contrary, the errors grow with time the numerical scheme is said to be unstable. The stability of numerical schemes can be investigated by performing von Neumann stability analysis. For time-dependent problems, stability guarantees that the numerical method produces a bounded solution whenever the solution of the exact differential equation is bounded. Stability, in general, can be difficult to investigate, especially when the equation under consideration is nonlinear.

In certain cases, von Neumann stability is necessary and sufficient for stability in the sense of Lax–Richtmyer (as used in the Lax equivalence theorem): The PDE and the finite difference scheme models are linear; the PDE is constant-coefficient with periodic boundary conditions and has only two independent variables; and the scheme uses no more than two time levels. Von Neumann stability is necessary in a much wider variety of cases. It is often used in place of a more detailed stability analysis to provide a good guess at the restrictions (if any) on the step sizes used in the scheme because of its relative simplicity.

Illustration of the method

The von Neumann method is based on the decomposition of the errors into Fourier series. To illustrate the procedure, consider the one-dimensional heat equation $$\frac{\partial u}{\partial t}=\alpha \frac{{\partial }^{2}u}{\partial x^2}$$ defined on the spatial interval $L$, with the notation $$u_j^n=u(x_j,t^n)$$ where $x_j$ are the specific x values, and $t^n$ are the sequence of t values.

We can discretize the heat equation as Template:NumBlk where $$r=\frac{\alpha \mathrm{\Delta }t}{{\left(\mathrm{\Delta }x\right)}^2}$$

Then the solution $u_j^n$ of the discrete equation approximates the analytical solution $u(x,t)$ of the PDE on the grid.

Define the round-off error ${ϵ}_j^n$ as $${ϵ}_j^n=N_j^n-u_j^n$$ where $u_j^n$ is the solution of the discretized equation (Template:EquationNote) that would be computed in the absence of round-off error, and $N_j^n$ is the numerical solution obtained in finite precision arithmetic. Since the exact solution $u_j^n$ must satisfy the discretized equation exactly, the error ${ϵ}_j^n$ must also satisfy the discretized equation. Here we assumed that $N_j^n$ satisfies the equation, too (this is only true in machine precision). Thus Template:NumBlk is a recurrence relation for the error. Equations (Template:EquationNote) and (Template:EquationNote) show that both the error and the numerical solution have the same growth or decay behavior with respect to time. For linear differential equations with periodic boundary condition, the spatial variation of error may be expanded in a finite Fourier series with respect to $x$, in the interval $L$, as Template:NumBlk where the wavenumber $k_m=\frac{\pi m}{L}$ with $m=-M,\dots ,-2,-1,0,1,2,\dots ,M$ and $M=L/\mathrm{\Delta }x$. The time dependence of the error is included by assuming that the amplitude of error $E_m$ is a function of time. Often the assumption is made that the error grows or decays exponentially with time, but this is not necessary for the stability analysis.

If the boundary condition is not periodic, then we may use the finite Fourier integral with respect to $x$: Template:NumBlk

Since the difference equation for error is linear (the behavior of each term of the series is the same as series itself), it is enough to consider the growth of error of a typical term: Template:NumBlk if a Fourier series is used or Template:NumBlk if a Fourier integral is used.

As the Fourier series can be considered to be a special case of the Fourier integral, we will continue the development using the expressions for the Fourier integral.

The stability characteristics can be studied using just this form for the error with no loss in generality. To find out how error varies in steps of time, substitute equation (Template:EquationNote) into equation (Template:EquationNote), after noting that $$\begin{array}{cc}{ϵ}_j^n& =E_m(t)e^{i{k}_{m}x}\\ {ϵ}_j^{n+1}& =E_m(t+\mathrm{\Delta }t)e^{i{k}_{m}x}\\ {ϵ}_{j+1}^n& =E_m(t)e^{i{k}_m(x+\mathrm{\Delta }x)}\\ {ϵ}_{j-1}^n& =E_m(t)e^{i{k}_m(x-\mathrm{\Delta }x)},\end{array}$$ to yield (after simplification) Template:NumBlk

Introducing $\theta =k_m\mathrm{\Delta }x\in [-\pi ,\pi ]$ and using the identities $$\sin \left(\frac{\theta }{2}\right)=\frac{e^{i\theta /2}-e^{-i\theta /2}}{2i}\to {\sin }^2\left(\frac{\theta }{2}\right)=-\frac{e^{i\theta }+e^{-i\theta }-2}{4}$$ equation (Template:EquationNote) may be written as Template:NumBlk Define the amplification factor Template:NumBlk The necessary and sufficient condition for the error to remain bounded is that $|G|\le 1.$ Thus, from equations (Template:EquationNote) and (Template:EquationNote), the condition for stability is given by Template:NumBlk Note that the term $4r{\sin }^2(\theta /2)$ is always positive. Thus, to satisfy Equation (Template:EquationNote): Template:NumBlk For the above condition to hold for all $m$ (and therefore all ${\sin }^2(\theta /2)$). The highest value the sinusoidal term can take is 1 and for that particular choice if the upper threshold condition is satisfied, then so will be for all grid points, thus we have Template:NumBlk Equation (Template:EquationNote) gives the stability requirement for the FTCS scheme as applied to one-dimensional heat equation. It says that for a given $\mathrm{\Delta }x$, the allowed value of $\mathrm{\Delta }t$ must be small enough to satisfy equation (Template:EquationNote).

Similar analysis shows that a FTCS scheme for linear advection is unconditionally unstable.