Operator splitting and splitting error
Approximate a combined evolution by ordered subflows and measure the noncommutativity that remains.
On this page
The question for today
What you’ll understand
- Write Lie and symmetric Strang compositions with an explicit order of application.
- Compute splitting errors for noncommuting finite matrices despite exact substeps.
- State why finite-dimensional order expansions do not automatically give mesh-uniform PDE estimates.
Many PDE models combine processes that are easy to evolve separately, such as transport, diffusion and reaction. Splitting alternates their subflows instead of solving the combined evolution in one step. Exact subflows do not generally compose into the exact total flow. Their order matters, and the resulting splitting error can remain even when spatial and subsolver errors have been removed.
Composition order is a mathematical choice
For a finite-dimensional autonomous linear system y′=(A+B)y with fixed matrices, the exact step is exp(time step times(A+B)). A Lie step applying A first and B second is exp(hB)exp(hA); the rightmost matrix acts first. Expanding both products through second order shows a local defect proportional to BA−AB. If the matrices commute, their exponentials combine exactly and this splitting error vanishes. The sign of the leading commutator reverses when the subflow order is reversed.
The symmetric Strang step applies a half A step, a full B step and a half A step. For fixed bounded matrices it has a third-order local defect and, on a fixed finite time interval with stable propagation, second-order global error. Lie splitting has second-order local and first-order global error under the corresponding finite-dimensional assumptions. These are different uses of the word order: a one-step defect has one extra power of h relative to the accumulated global error over order 1/h steps.
Exact substeps can still miss the combined dynamics
A useful example uses one nilpotent shear matrix for A and its transpose for B. Their individual exponentials are identity plus h times the matrix, so the substeps are exact and elementary. Their sum generates hyperbolic sine and cosine, showing that the combined motion contains interactions not present in one isolated shear. The Lie result misses a second-order component, while the symmetric composition cancels that leading defect but leaves higher-order terms.
This example separates splitting error from inaccurate subsolves. In an implementation, approximate subflows add their own errors and can destroy the intended composition order if solved too loosely. A second-order splitting with a first-order subsolver does not automatically stay second order. Also, stability of each isolated physical process is not a substitute for analyzing the composed approximation in the relevant norm, particularly when the split operators are nonnormal or when negative substeps are introduced.
PDE operators need domain and regularity control
After spatial discretization, A and B become matrices depending on the mesh. Constants in a formal splitting expansion can grow as that mesh is refined because spatial derivatives and commutators become large. A finite-dimensional order claim at fixed mesh therefore does not establish a PDE estimate uniform in spatial resolution. For unbounded differential operators one must control operator domains, solution regularity, boundary compatibility and the stability of each propagated subproblem.
Boundary forcing can be especially delicate: an intermediate split state may fail the compatibility conditions required by the next subflow, producing order reduction. Nonautonomous coefficients require the correct time placement or an augmented formulation, rather than copying an autonomous composition blindly. The examples here use fixed matrices and homogeneous algebraic initial data, where all expansions are legitimate. They illustrate the mechanism of splitting error while keeping broader PDE convergence conditional on the additional analytic estimates that make the formal commutators meaningful.
Work it through
Two exact shears versus the exact combined flow
Use the displayed A,B, initial vector y₀=(1,0) and h=0.2. Compute the A-then-B Lie result, the A/2-B-A/2 Strang result and their Euclidean errors against the exact solution.
Since A y₀=0, the first full A substep leaves y₀ unchanged; the B substep gives Lie result(1,0.2). The symmetric sequence gives(1+h²/2,h)=(1.02,0.2).
The exact result is(cosh 0.2,sinh 0.2)≈(1.020066756,0.201336003). These components include the interaction of both operators.
The Euclidean Lie error is approximately 0.02011118, while the Strang error is approximately 0.001337669. Neither is zero despite exact substeps; the symmetric construction has canceled the leading h² defect.
At this step, Strang is more accurate but still differs from the combined evolution. Exact subflows alone do not eliminate noncommutativity error.
The living notebook
Explore the model
Interactive lab · matrix
Scaling and shear do not commute
Pause and Reset, then set diagonal scale a = 1.50 and shear b = 1. With D=diag(1.5,1) and S=[[1,1],[0,1]], this selected final matrix is SD, sending(0,1) to(1,1). Reset and set both a = 1.50 and b = 1.50: the final matrix is DS and sends(0,1) to(1.5,1). Predict determinant 1.5 in both runs but different transformed corners. Playback interpolates the geometry; readouts describe each selected final matrix, not a splitting-time trajectory.
- Area scale · det A
- 1.4
- Singular values · σmax, σmin
- 1.597, 0.876
- Condition number · κ₂(A)
- 1.823
The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forEqual area scaling does not make two ordered transformations identical.
Pause & reason
Check your understanding
Your turn
Try it yourself
Let A=diag(1,−1),B=diag(2,3),y₀=(1,1),h=0.1. Compute the exact combined step and compare Lie and Strang. Explain why this special calculation does not prove general PDE splitting exactness.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
The matrices are diagonal and commute. Add their diagonal entries before exponentiating, then compare with multiplying their scalar exponentials.
Compare with the solution
The sum is diag(3,2), so the exact result is . The Lie product multiplies the two scalar exponentials in each coordinate and gives exactly the same vector; the symmetric Strang product does as well. This vanishing error is a consequence of commuting fixed matrices and exact substeps. Differential operators with variable coefficients, boundary forcing or incompatible domains need not commute, and their composition estimates can depend on spatial resolution. The example isolates an exact special case rather than supplying a theorem for those broader settings.
Keep the idea
Take it with you
- Subflow order matters whenever the split generators fail to commute.
- Local splitting defects and global error orders differ by one power under stable accumulation.
- PDE order claims require regularity, domain, boundary and mesh-uniform estimates beyond fixed-matrix expansions.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.