advanced28 min studyLesson 637 in Mathematics

Martingale exposure and Azuma’s inequality

Reveal randomness gradually and bound changes in conditional predictions rather than assuming independent increments.

On this page

What you’ll understand

  • Construct a Doob martingale from a combinatorial statistic and an exposure filtration.
  • Justify deterministic increment bounds through a coupling of unrevealed choices.
  • Apply the appropriate Azuma bound and compare alternative exposure orders.

Many interesting graph statistics are not sums of independent indicators. A martingale replaces an independent-sum decomposition with a sequence of conditional predictions. Each revelation updates the predicted final answer, and bounded updates can give concentration. The difficult combinatorial step is not inserting numbers into Azuma’s inequality; it is proving that the chosen exposure cannot change the conditional prediction too much.

Expose information without changing the final statistic

Let F be an integrable real statistic determined by finitely many independent random choices. After revealing the first i choices, let M_i be the conditional expectation of F given that information. The tower property says the expected next prediction, conditional on the present, is the present prediction. Thus M is a martingale starting at the unconditional mean and ending at F. Its increments need not be independent and are usually functions of the information already exposed.

To bound one increment, freeze the previous revelations and compare two possible values of the next choice. Couple the remaining random choices identically in the two completions. If changing that one exposed choice changes F by at most c in every such paired completion, the conditional expectations range across an interval of length at most c. In particular, the actual prediction differs from their conditional average by at most c. This supplies a valid, sometimes conservative, absolute increment bound for Azuma.

Mi=E[F∣Fi],E[Mi∣Fi−1]=Mi−1,M0=EF,MN=FM_i=\mathbb E[F\mid\mathcal F_i],\qquad \mathbb E[M_i\mid\mathcal F_{i-1}]=M_{i-1},\qquad M_0=\mathbb E F,\quad M_N=F
The final filtration reveals all randomness determining F; each conditional expectation uses the same underlying experiment.↔ Scroll wide equations horizontally.

Track the sum of squared sensitivities

If martingale increments have deterministic almost-sure bounds c_i with a positive sum of squares, Azuma controls a one-sided deviation t by an exponential involving that sum. If the sum is zero the martingale is constant, so positive deviations have probability zero and need no division formula. Applying the same theorem to minus M gives the lower tail, and summing gives a two-sided bound. A bound valid only on typical configurations is not automatically an Azuma hypothesis: exceptional increments must be handled by a stopping argument or a theorem explicitly allowing them. Nor can a bound on the final statistic’s variance simply replace the increment bounds.

Exposure order changes both the number and size of the increments. For graph coloring, reveal the independent blocks consisting of each vertex’s edges to earlier vertices. Changing one block modifies only edges incident to one vertex. Removing that vertex leaves exactly the same induced graph in both completions. Each chromatic number lies between the chromatic number of the common graph and one more, so the two values differ by at most one. There are n blocks instead of approximately n squared edge revelations.

∣Mi−Mi−1∣≤ci a.s.⟹P(MN−M0≥t)≤exp⁡ ⁣(−t22∑i=1Nci2),t>0|M_i-M_{i-1}|\le c_i\ \text{a.s.}\quad\Longrightarrow\quad\mathbb P(M_N-M_0\ge t)\le\exp\!\left(-\frac{t^2}{2\sum_{i=1}^{N}c_i^2}\right),\quad t>0
This is the absolute-increment version of Azuma; a sharper interval-width theorem has different constants and is not being substituted here.↔ Scroll wide equations horizontally.

Concentration does not identify the center

A tail theorem around the expectation may be powerful even when the expectation has no explicit formula. It says repeated draws are usually close to a common center, but another argument is needed to locate that center. For chromatic number, deterministic graph bounds, first moments, or a more refined random-graph analysis may estimate it. The concentration calculation itself does not claim a numerical coloring algorithm, an efficiently computable expectation, or a sharp description of the distribution.

Stopping-time care is especially important in random graph processes whose sensitivities grow near a boundary. A proof can stop the process before the bad region, bound the stopped increments, and separately estimate the probability of reaching that region. The filtration must still describe everything known so far, and the stopped process must be defined consistently. This discipline carries over to dynamic concentration and the differential equation method, where a martingale controls accumulated random fluctuations while a deterministic equation describes the expected drift.

One hundred vertex revelations

Let F be the chromatic number of G(100,p), for any fixed p in [0,1]. Use vertex-block exposure to bound P(F−E F≥20) and the corresponding two-sided probability.

  1. Reveal the independent edge blocks indexed by their larger endpoint. Coupling future blocks identically, changing one block changes only edges incident to its vertex and therefore changes chromatic number by at most one.

  2. The Doob martingale has one hundred increments bounded in absolute value by one, so the sum of squared bounds is at most one hundred.

  3. Azuma gives P(F−EF≥20)≤exp⁡(−400/200)=e−2≈0.135335\mathbb P(F-\mathbb E F\ge20)\le\exp(-400/200)=e^{-2}\approx0.135335. Applying the same estimate to −F and summing bounds the two-sided event by 2e−2≈0.2706712e^{-2}\approx0.270671.

The result

The one-sided bound is e⁻² and the two-sided bound is 2e⁻². The expectation is the center, and no explicit value for it was needed.

Explore the model

Interactive lab

Interactive lab · probability

A martingale whose predictions are explicit

Pause and Reset, then set p = 0.50 and n = 20. For the final success count K, imagine revealing Bernoulli trials one at a time: M_i equals observed successes plus (20−i)/2. Predict initial expectation ten and variance five. The actual prediction increments are ±1/2, so Azuma bounds P(K−10≥5) by e⁻²⋅⁵, approximately 0.0821. Inspect the exact upper-tail bars. This lab displays the terminal independent-binomial distribution, not an exposure-path animation or a chromatic-number simulator.

A martingale whose predictions are explicitThese are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forConditional predictions form a martingale even when the theorem is applied to statistics much more complicated than a sum.

Check your understanding

What must be justified before applying the displayed Azuma bound?

Try it yourself

A Doob martingale has forty increments, each bounded in absolute value by two. Bound its upper deviation of sixteen. If another valid exposure has ten increments bounded by four, which displayed estimate is better?

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Compare the sums of squared increment bounds, not just the number of steps or their largest bound.

Compare with the solution

The first exposure has squared-bound sum 40⋅22=16040\cdot2^2=160, giving exp⁡(−162/(2⋅160))=e−0.8≈0.449329\exp(-16^2/(2\cdot160))=e^{-0.8}\approx0.449329. The second has 10⋅42=16010\cdot4^2=160, so it gives exactly the same upper bound. Fewer steps do not necessarily improve Azuma when their sensitivities increase. Both comparisons require the advertised bounds to hold almost surely for the conditional-prediction increments under their own filtrations. A typical observed change, or a statement only about final-statistic variance, would not supply the same hypothesis.

Take it with you

  • A Doob martingale tracks conditional predictions of one fixed final statistic.
  • A coupling can convert combinatorial sensitivity into valid prediction-increment bounds.
  • Azuma depends on squared increment bounds and concentrates around a center that may still need separate analysis.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.