Lyapunov exponents and the horizon of prediction
Relate tangent-space growth to finite forecasting horizons while separating transient sensitivity from asymptotic chaos.
On this page
The question for today
What you’ll understand
- Calculate an exponent for a simple expanding map.
- Estimate a forecast horizon from uncertainty and a positive local growth rate.
- Explain the limits of finite-time growth as evidence for asymptotic chaos.
Determinism says that an exact initial state and an exact law select a future. Prediction adds a different requirement: available initial data must be precise enough to keep the forecast useful. Lyapunov exponents quantify how infinitesimal perturbations grow or shrink along an orbit. They connect mathematical instability with a practical accuracy budget, provided the limit, the orbit, and the units are specified. They do not eliminate uncertainty by giving it a sophisticated name.
Follow a perturbation along the actual orbit
For a differentiable map, a small displacement evolves approximately by the derivative evaluated at the current orbit point. After several steps, the relevant factor is a product of derivatives, not a derivative evaluated once at the starting point. Taking logarithms turns this product into an average of local logarithmic stretching. When a suitable long-time limit exists, it defines an exponent for that orbit. Different invariant sets or exceptional orbits of the same system can have different exponents.
For a multidimensional flow, evolve the variational equation along the trajectory and track independent perturbation directions. An exponent has units of inverse time when time is dimensional, whereas a map exponent is commonly quoted per iteration. Smooth coordinate changes whose derivatives and inverse derivatives stay uniformly bounded along the orbit preserve asymptotic exponents, but finite-time values and their numerical conditioning can change. Always state the clock and norm when reporting a finite-time sensitivity estimate or comparing two calculations.
Translate growth into an accuracy budget
While a perturbation remains in the linear regime, a positive growth rate suggests an uncertainty envelope proportional to . Set a tolerable error and solve for the time at which the envelope reaches it. Reducing initial uncertainty buys time only logarithmically. Improving precision by a factor of ten adds a fixed interval determined by the growth rate, rather than multiplying the forecast horizon by ten. This is a statement about state prediction, not about the inability to predict any statistic.
A chaotic system can still have reproducible distributions, average fluxes, or other coarse observables. Weather-like trajectory uncertainty and climate-like statistical regularity are conceptually compatible, although proving either for a particular model requires additional work. Model error and noisy forcing also enter a forecast; an initial-condition exponent alone does not capture them. Once the perturbation reaches the attractor's size, the exponential separation law saturates and cannot be extrapolated to physically impossible distances.
Evidence requires the right limit
A positive finite-time exponent can arise during a transient near an unstable state before a trajectory settles to a stable attractor. An unbounded equation such as a scalar exponentially growing mode also separates trajectories without a bounded recurrent chaotic attractor. A persuasive chaos claim therefore combines sustained positive stretching with the relevant bounded invariant dynamics and checks appropriate to the system. A single number computed over a short interval is a diagnostic, not a complete dynamical classification.
Numerically, two ordinary trajectories eventually separate too far for their difference to represent a tangent vector, while making the initial difference too small invites roundoff. Evolving the variational equation and periodically renormalizing tangent vectors avoids that particular saturation problem. Multiple directions need orthogonalization to recover a spectrum. Repeat the calculation with longer observation, discarded transients, and numerical refinement. Convergence evidence does not prove every mathematical limit, but it makes the claimed finite-time result reproducible and exposes obvious numerical artifacts.
Work it through
A doubling map's forecast budget
For , take an orbit avoiding the discontinuity in the chosen interval representation. Use initial local error and tolerance to estimate the local prediction horizon.
Away from representation boundaries the derivative magnitude is two, so the tangent multiplier over n updates is and the asymptotic exponent is per update.
Solve . This gives . The estimate concerns local or circle-distance separation before folding and saturation, not the raw difference across a wrapped coordinate cut.
After thirteen updates the linear estimate is , still below tolerance; after fourteen it is , above tolerance. A tenfold smaller initial error adds updates.
The estimated horizon is about thirteen updates at the stated tolerance. Exact wrap crossings and finite perturbations require an appropriate distance convention; the tangent exponent remains a local growth concept.
The living notebook
Explore the model
Interactive lab · optimization
Count a known multiplier's growth
Choose η=2.5 and a small initial x₀. Predict the magnitude growth factor 1.5 per update, then Step and inspect the values. The multiplier is constant in this quadratic gradient-descent illustration. Its unbounded expansion is not a chaotic attractor and does not measure an exponent for the logistic map.
- Position x0
- 2
- Objective x²/2
- 2
- Iteration behavior
- Stable step
Gradient descent on f(x) = x²/2: xₙ = (1 − η)ⁿx₀. Playback advances two discrete iterations per second. Values outside |x| ≤ 4 are explicitly reported. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forExponential separation can be demonstrated without chaos; bounded recurrent dynamics is additional evidence.
Pause & reason
Check your understanding
Your turn
Try it yourself
A sustained rate is . An instrument improves initial uncertainty from to while the tolerance is unchanged. How much forecast time is gained in the exponential regime?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Subtract the two logarithmic horizon formulas; the tolerance cancels.
Compare with the solution
The uncertainty improves by a factor of one hundred, so the gain is . This is an additive gain, conditional on the same sustained growth rate and the same useful linear-error range. It is not a guarantee for a model whose error, external noise, or local growth rate changes during the interval.
Keep the idea
Take it with you
- Exponents average tangent growth along a specified orbit with a specified clock.
- A positive growth rate gives a logarithmic accuracy-to-horizon relation within its regime.
- Finite-time stretching, asymptotic chaos, and statistical predictability are distinct claims.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.