advanced28 min studyLesson 640 in Mathematics

Random processes and the differential equation method

Convert conditional drift into an ODE and control the stochastic error uniformly before a valid stopping boundary.

On this page

What you’ll understand

  • Derive the normalized time and state scales from one-step conditional drift.
  • State bounded-increment, trend, regularity, initial-condition, and stopping hypotheses.
  • Verify a complete empty-bin process example and distinguish expectation tracking from pathwise concentration.

A random process can have thousands of individually unpredictable updates and still follow a stable macroscopic trajectory. The differential equation method formalizes this behavior by separating conditional drift from martingale noise. Deriving an ODE is only the beginning. A valid tracking theorem also controls step sizes, the accuracy of the drift approximation, the stability of the limiting equation, and the interval on which those conditions remain true.

Identify time and state scales together

Suppose the state coordinates Y_i(k) are of order n and one discrete update changes them by order one. Then the natural scaled state is Y_i/n and natural time is k/n. If the conditional expected increment is approximately a function f_i of scaled time and scaled state, an update changes the scaled state by approximately f_i/n. Dividing by the time increment 1/n suggests derivative f_i. A missing factor of n here creates a different ODE rather than a harmless notation change.

Consider independently placing balls, one at a time, into n uniformly chosen bins. Let U(k) count empty bins. Given the entire placement history, the next ball hits an empty bin with probability U(k)/n. Therefore U decreases by one with that probability and stays fixed otherwise. The conditional drift is exactly minus U/n. With u(0)=1 the proposed normalized equation is u′=−u, whose solution is exponential decay. The process remains random; the ODE describes its large-system trajectory.

E[U(k+1)−U(k)∣Fk]=−U(k)n,u′(t)=−u(t),u(0)=1,u(t)=e−t\mathbb E[U(k+1)-U(k)\mid\mathcal F_k]=-\frac{U(k)}n,\qquad u'(t)=-u(t),\quad u(0)=1,\quad u(t)=e^{-t}
The experiment uses independent uniform bin choices, and the scaling is U(k)/n at time t=k/n.↔ Scroll wide equations horizontally.

A usable bounded-jump tracking statement

Here is a restricted sufficient framework on a fixed finite time interval. Consider a fixed finite number of adapted coordinates bounded by a constant times n. Their initial normalized vector converges in probability to the specified deterministic ODE initial value y(0). Before exit from a fixed bounded domain, all coordinate jumps are bounded almost surely by a constant independent of n, and all conditional drifts differ from the corresponding f_i by an error tending uniformly to zero. The functions f_i are bounded and Lipschitz on a neighborhood of the candidate trajectory, including its time coordinate.

Assume the ODE solution exists through the fixed terminal time and stays a positive distance from the domain boundary. Under those hypotheses the maximum normalized tracking error over all discrete times through n times that terminal time tends to zero in probability. The martingale part has sublinear cumulative fluctuation by bounded-jump concentration, while the drift approximation and discretization errors accumulate sublinearly. A discrete Gronwall estimate prevents Lipschitz feedback from amplifying these errors to macroscopic size on a fixed interval. This is a bounded-jump specialization, not the most general form of Wormald’s theorem.

max⁡0≤k≤⌊nT⌋max⁡1≤i≤a∣Yi(k)n−yi(k/n)∣→P0,yi′=fi(t,y),a,T fixed\max_{0\le k\le\lfloor nT\rfloor}\max_{1\le i\le a}\left|\frac{Y_i(k)}n-y_i(k/n)\right|\xrightarrow{\mathbb P}0,\qquad y_i'=f_i(t,y),\quad a,T\text{ fixed}
This conclusion requires the bounded-jump, uniform-trend, Lipschitz, initial-value and interior-trajectory hypotheses stated in the prose.↔ Scroll wide equations horizontally.

Stopping boundaries and expectations are different issues

If the ODE approaches a singularity, a depleted resource, or the boundary where the drift formula changes, the previous uniform theorem cannot simply be extended by drawing a longer curve. Stop before that region and verify a new set of estimates if a later regime is needed. Likewise a bound allowing rare large jumps needs an explicit exceptional-event analysis; average small increments are not the same as almost-sure bounded increments. These are common points where a persuasive heuristic fails to become a theorem.

For empty bins the exact expectation is n(1−1/n)kn(1-1/n)^k, because each specified bin is missed by all k independent balls. This expectation approaches ne−k/nne^{-k/n} on fixed scaled intervals, but an expectation calculation alone would not show that an entire realized trajectory stays close. The bounded-jump tracking argument supplies that additional probability statement. Neither result says the bin-empty indicators are independent: their dependence is compatible with a simple conditional drift and controlled fluctuations of the total count.

A thousand bins after five hundred placements

For n=1000 and k=500 independent uniform ball placements, derive the exact expected empty-bin count and compare it with the ODE prediction.

  1. A specified bin is missed with probability (999/1000)500(999/1000)^{500}. Sum its indicator across one thousand bins to obtain exact expectation 1000(0.999)5001000(0.999)^{500}.

  2. The scaled time is t=500/1000=1/2. Solving u′=−u with u(0)=1 gives ODE prediction 1000e−1/21000e^{-1/2}.

  3. The exact expectation is approximately 606.378945 and the ODE prediction approximately 606.530660, a difference of approximately 0.151715. Bounded increments and exact drift support asymptotic uniform path tracking on fixed intervals, but these decimals alone are not a finite-sample probability bound.

The result

The expectation and fluid prediction are close but distinct. Pathwise high probability tracking needs concentration in addition to expectation matching.

Explore the model

Interactive lab

Interactive lab · markov

An exact discrete decay as a scaling analogue

Pause and Reset, then set transition p = 0.10 and q = 0. The chain starts in state zero, and after n steps its state-zero probability is 0.9ⁿ. Step ten times to reach n=10 and predict 0.9¹⁰≈0.3487, compared with e⁻¹≈0.3679 at scaled time np=1. Reset and set both p = 0.05 and q = 0, then Step twenty times: predict 0.95²⁰≈0.3585 at the same scaled time. Each Step advances one chain transition. The instrument computes probabilities of a two-state chain, not bin occupancies or random process realizations.

An exact discrete decay as a scaling analogueExact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Current readings: P(state 1) at step 0: 0%; Stationary P(state 1): 60%; Chain behavior: Monotone convergence. All parameters are adjustable with the labeled controls below.Two-state Markov distribution after 0 steps: state zero probability 1, state one probability 0.Initial distribution (1, 0) · step 0p = 0.3q = 0.201100%0%1−p1−qP(0)P(1)Monotone convergence
P(state 0)P(state 1)Stationary distribution
P(state 1) at step 0
0%
Stationary P(state 1)
60%
Chain behavior
Monotone convergence
t = 0 s

Exact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forSmaller discrete increments can approach an exponential fluid law, but a probability recursion is separate from concentration of a random trajectory.

Check your understanding

Which additional ingredient is essential before promoting a drift-derived ODE into the stated uniform tracking conclusion?

Try it yourself

Start with n bins and place floor(n log 2) independent uniform balls. Find the limiting expected empty fraction and the limiting empty fraction in probability. Explain why the second statement needs more than the first.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Use the exact missing-bin probability and the solution u(t)=e to the power minus t on a fixed scaled interval.

Compare with the solution

The exact expected empty fraction is (1−1/n)⌊nlog⁡2⌋(1-1/n)^{\lfloor n\log2\rfloor}, which tends to e−log⁡2=1/2e^{-\log2}=1/2. The empty-bin process has jumps at most one, exact conditional drift −U/n and a globally Lipschitz drift function. Its initial fraction is one, and the exponential solution stays inside a suitable fixed domain through a terminal time slightly beyond log 2. The bounded-jump tracking theorem therefore gives U(⌊nlog⁡2⌋)/n→1/2U(\lfloor n\log2\rfloor)/n\to1/2 in probability. The expectation limit alone could have concealed large fluctuations; the tracking statement rules those out and controls earlier times as well.

Take it with you

  • Derive normalized time and state scales before writing the limiting ODE.
  • Conditional drift, bounded fluctuations and Lipschitz stability play different roles in tracking.
  • Uniform path approximation applies only while its hypotheses and stopping-domain control remain valid.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.