Differential-algebraic equations and index
Distinguish implicit ODEs from constrained DAEs, initialize consistent data, and interpret differentiation index under regularity assumptions.
On this page
The question for today
What you’ll understand
- Recognize regular semi-explicit index-one DAEs.
- Construct initial states and derivatives that satisfy algebraic constraints.
- Explain hidden constraints and why an implicit integrator alone does not reduce DAE index.
Some dynamical models determine rates and enforce algebraic relations at the same time. A constrained mechanical coordinate, an electrical conservation law, or an instantaneous equilibrium variable may not have an independent differential equation. Such a system is not made into an ordinary differential equation merely by choosing an implicit time integrator. Its constraints restrict allowable initial data and may hide further derivative relations. The differentiation index describes one aspect of that structure under a specified regularity convention.
An algebraic variable is not an arbitrary initial value
A semi-explicit DAE has differential variables x and algebraic variables z, with and . If the Jacobian of g with respect to z is nonsingular near a consistent point, the implicit function theorem locally determines z from t and x. Substitution then defines a local ODE for x. Differentiating the constraint once determines z prime. Under the usual differentiation-index convention, this regular semi-explicit form is index one.
Consistent initial data must satisfy the algebraic constraint, and the initial derivative must satisfy its differentiated relation. Assigning arbitrary values to both x and z usually violates those requirements. A residual-form solver instead accepts an equation involving time, state, and derivative, but its inputs must still be mutually consistent. A regular implicit ODE whose derivative Jacobian is invertible is locally solvable directly for the derivative and is index zero under this convention; implicit notation by itself does not make a DAE high index.
Differentiation can reveal hidden constraints
A Cartesian pendulum illustrates why checking only the position constraint is insufficient. Position must remain on a circle, so differentiating its squared-length constraint requires velocity to be tangent to that circle. Differentiating again relates acceleration and speed, allowing the constraint multiplier to be determined under regularity. The velocity condition is a hidden constraint: a position can lie on the circle while an arbitrarily assigned outward velocity makes the initial state inconsistent.
In the position-constrained first-order pendulum formulation, two differentiations reveal the multiplier and a third determines its derivative. It is conventionally an index-three system when the multiplier is included among the unknowns. Index is tied to the formulation and to regularity assumptions, not simply to the number of equations written with an equals sign. Eliminating variables, using independent coordinates, or introducing derivative constraints can change the index while also introducing numerical issues such as drift from the original constraint.
Constraint-aware discretization and error control
For a regular index-one problem, an implicit step can solve differential and algebraic residuals together, enforcing the algebraic constraint at accepted endpoints up to the solve tolerance. That endpoint condition does not automatically give an equally accurate dense-output constraint between steps. Higher-index systems may need index reduction, specialized formulas, or projection onto the relevant constraint manifolds. Projection can reduce drift, but its effect on order, momentum, and geometry must be analyzed rather than assumed beneficial in every respect.
Algebraic variables can be sensitive to differential errors when their constraint Jacobian is poorly conditioned. Scaling and Jacobian structure therefore matter for both initialization and time stepping. Modern DAE solvers provide consistent-initialization routines for specified classes, not arbitrary cures for every singular model. A structural singularity may indicate redundant constraints, a changing constraint rank, or an ill-posed physical formulation. Tightening a tolerance alone cannot resolve such a modeling problem, and a successful residual solve does not by itself establish a valid trajectory.
Work it through
A consistent algebraic partner
Consider x′=−x+z and 0=x+z−t, with x(0)=0. Find consistent initial z and derivatives, then take one coupled backward-Euler step with h=0.1.
The initial constraint gives z(0)=0. The differential equation gives x′(0)=0, and differentiating x+z−t=0 gives z′(0)=1−x′(0)=1.
At time 0.1, backward Euler requires X₁=0.1(−X₁+Z₁), while the algebraic equation gives Z₁=0.1−X₁.
Substitute to obtain 1.2X₁=0.01, so X₁=1/120≈0.0083333333 and Z₁=11/120≈0.0916666667. Their sum is exactly 0.1, satisfying the endpoint constraint.
The step solves the differential update and the algebraic relation together. The algebraic value is determined by consistency rather than chosen independently.
The living notebook
Explore the model
Interactive lab · matrix
Regularity and sensitivity of an algebraic Jacobian
Pause and Reset, then set diagonal scale a=1 and shear b=0. Predict determinant and condition number. For a fresh comparison, Reset and set a=0.25 and b=0. Interpret the selected matrix as a simple algebraic Jacobian and predict how much its first-coordinate inverse amplifies a residual.
- Area scale · det A
- 1.4
- Singular values · σmax, σmin
- 1.597, 0.876
- Condition number · κ₂(A)
- 1.823
The selected matrix is A = [[a,b],[0,1]]. Playback interpolates geometry between the identity and A; readouts always describe A. Its determinant is a and its singular values come from AᵀA. Positive a makes every supported matrix invertible. This two-dimensional family is not a general eigensolver or a learned network. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe determinants are one and 0.25; the condition numbers are one and four. The second inverse multiplies a first-coordinate residual by four. Every selectable matrix remains invertible; this family does not simulate a DAE or demonstrate an actual rank-changing constraint.
Pause & reason
Check your understanding
Your turn
Try it yourself
For x′=−x+z and 0=x²+z−1, choose x(0)=0.5. Find consistent z(0), x′(0), and z′(0). Would z(0)=0.6 be consistent?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
First satisfy the algebraic equation, then differentiate it once and use the differential equation.
Compare with the solution
The constraint gives z(0)=1−0.5²=0.75. Therefore x′(0)=−0.5+0.75=0.25. Differentiating x²+z−1=0 gives 2xx′+z′=0, so z′(0)=−2·0.5·0.25=−0.25. The choice z(0)=0.6 has residual 0.25+0.6−1=−0.15 and is inconsistent. Here g_z=1, so the algebraic variable is locally regular despite the nonlinear x dependence.
Keep the idea
Take it with you
- Consistent DAE data satisfy both algebraic relations and the necessary derivative constraints.
- Index describes a regular formulation's differentiation structure, not its implicit notation.
- Constraint regularity, initialization, interpolation, and solve tolerances all belong in a DAE computation.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.