advanced31 min studyLesson 656 in Mathematics

Coupling and coalescence bounds

Build joint chains with correct marginal transitions and turn persistent meetings into quantitative distributional guarantees.

On this page

What you’ll understand

  • Apply the coupling inequality to a joint law with prescribed marginals.
  • Construct a coupling that remains together after its first meeting.
  • Bound mixing through a refresh event while distinguishing an upper bound from an exact distance.

Coupling compares two probability laws by placing their random objects on the same probability space. For Markov chains, a useful construction makes two copies gradually forget their different initial states and then evolve identically. The method is powerful because the probability that they have not yet joined can be easier to estimate than a matrix power. Its validity nevertheless depends on two checks: each coordinate must still have the required chain law, and a first meeting must be made permanent before its tail can bound disagreement at later times.

Dependence is chosen, marginals are prescribed

A coupling of μ and ν is any joint pair U,V whose individual laws are μ and ν. Their dependence is free to choose. For every event A, its two membership indicators can differ only when U and V differ, giving total variation at most the mismatch probability. On finite or countable spaces, a maximal coupling achieves equality by matching the common mass at each point. That static result does not automatically produce an efficient time-consistent coupling of entire Markov paths, so a path construction still needs to be specified.

A Markovian coupling chooses a transition law for the pair of states such that each coordinate’s conditional next-state marginal is the original kernel from its own present state. Sharing random choices is one way to arrange this, but using identical numerical noise without checking the resulting marginals can be wrong. The second chain may be started from π, making its marginal stationary at every time. A bound uniform over the first starting state then gives a worst-case mixing guarantee. Independence between the copies is neither required nor usually desirable.

∥μ−ν∥TV≤P(U≠V),∑y′K((x,y),(x′,y′))=P(x,x′),∑x′K((x,y),(x′,y′))=P(y,y′)\|\mu-\nu\|_{\mathrm{TV}}\leq\mathbb P(U\ne V),\qquad\sum_{y'}K((x,y),(x',y'))=P(x,x'),\quad\sum_{x'}K((x,y),(x',y'))=P(y,y')
The pair kernel K can correlate the copies, but its coordinate transition marginals must remain P.↔ Scroll wide equations horizontally.

A meeting time must mean lasting agreement

Define T as the first time the copies agree. To use its tail directly, construct the pair so that once agreement occurs, both copies take the same subsequent random transition. Then disagreement at time t is exactly the event T exceeds t. Merely running independent copies allows them to meet and later separate, so their first-meeting tail need not bound later mismatch. A standard repair is to use any valid pair update while states differ and switch to an identical draw from their common row whenever they coincide.

For a finite irreducible aperiodic chain, suitable couplings can establish convergence, but their quantitative efficiency can vary greatly. A poor coupling may wait much longer than the true mixing time. The coupling inequality is an upper bound, and a large upper bound does not prove slow mixing. Lower bounds instead need a distinguishable event, a slow eigenfunction or another obstruction. When the coupling starts one coordinate in equilibrium, random initial agreement can also improve the tail beyond a simpler bound that assumes the two copies initially differ.

T=inf⁡{t≥0:Xt=Yt},Xt=Yt for t≥T ⟹ ∥Pt(x,⋅)−π∥TV≤Px,π(T>t)T=\inf\{t\geq0:X_t=Y_t\},\quad X_t=Y_t\ \text{for }t\geq T\ \Longrightarrow\ \|P^t(x,\cdot)-\pi\|_{\mathrm{TV}}\leq\mathbb P_{x,\pi}(T>t)
The lasting-coalescence property is part of the construction. The second coordinate starts in π and keeps that marginal law.↔ Scroll wide equations horizontally.

A common refresh erases the past

Consider a refresh kernel that holds its present state with probability one minus α and otherwise draws a new state from a fixed probability π, where α is positive and at most one. Couple two copies using the same refresh indicator and, at a refresh, the same new π-draw. Both marginals are correct and the first refresh makes them identical forever. The probability of no refresh in t transitions is (1−α)ᵗ, furnishing a uniform upper bound. The draw is a complete refresh of the state, not one coordinate of a larger configuration.

This special kernel also has an exact formula: before any refresh it remembers the initial point, while after a refresh its law is π. Its TV distance from a point x is therefore (1−π(x))(1−α)ᵗ. The missing prefactor explains why the no-refresh bound can be loose. More elaborate couplings use monotonicity, path metrics or contraction of expected distance, but their conclusions still rest on the same requirements of correct coordinate laws and a demonstrated route from the coupling quantity to probability of disagreement.

A three-state chain forgets by refreshing

Let π be uniform on three states and P=(3/4)I+(1/4)Π, where every row of Π is π. Construct a coalescing coupling and find the exact mixing time at tolerance 1/4.

  1. At each transition share a Bernoulli refresh indicator of probability 1/4. On refresh both copies choose the same independent uniform state; otherwise both hold. These updates have the required marginal rows and preserve any existing agreement.

  2. The no-refresh probability is (3/4)ᵗ. The exact worst-case TV distance is smaller: d(t)=(2/3)(3/4)ᵗ, because a point mass differs from uniform by 2/3.

  3. At t=3 the exact distance is 9/32, above 1/4. At t=4 it is 27/128, below 1/4, so four transitions suffice and are necessary.

The result

The common-refresh construction proves an upper bound, while the explicit mixture gives the sharper exact profile and mixing time four.

Explore the model

Interactive lab

Interactive lab · markov

Exact marginals can support a coupling calculation

Pause and Reset, then set p=0.20,q=0.30. Predict stationary P(state 1)=0.40 and after three Steps P(state 1)=0.35. The resulting state-0 TV error is 0.05. A common-uniform coupling of the two rows coalesces with probability 0.50 per transition while different, giving mismatch bound (0.50)³=0.125. For a fresh comparison Reset and set p=0.30,q=0.20; predict error 0.075 after three Steps. The SVG shows marginal laws, not paired sample paths or a simulated coupling time.

Exact marginals can support a coupling calculationExact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Current readings: P(state 1) at step 0: 0%; Stationary P(state 1): 60%; Chain behavior: Monotone convergence. All parameters are adjustable with the labeled controls below.Two-state Markov distribution after 0 steps: state zero probability 1, state one probability 0.Initial distribution (1, 0) · step 0p = 0.3q = 0.201100%0%1−p1−qP(0)P(1)Monotone convergence
P(state 0)P(state 1)Stationary distribution
P(state 1) at step 0
0%
Stationary P(state 1)
60%
Chain behavior
Monotone convergence
t = 0 s

Exact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forA coupling bound can be checked against an exact marginal error without treating the display as two sampled trajectories.

Check your understanding

Why can the first-meeting tail fail to bound later mismatch for independently evolving copies?

Try it yourself

For p=0.20,q=0.30, update both chains using the same uniform U: the next state is 1 when U is below the appropriate row’s probability of state 1. Starting from different states, find the coalescence probability and compare its three-step tail with exact worst-case TV.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

The two thresholds are 0.20 and 0.70. Identify the interval where they produce different outcomes, then use the stationary prefactor.

Compare with the solution

The outcomes differ only for U in [0.20,0.70), an interval of length 1/2. Thus while different the copies coalesce with probability 1/2 per transition. Once equal, the same threshold preserves equality. Starting different, P(T>3)=1/8. The stationary law is (3/5,2/5), so exact worst-case TV at three is (3/5)(1/2)³=3/40. It is below the coalescence bound, illustrating that this bound need not be an equality.

Take it with you

  • A coupling chooses dependence while preserving both marginal laws.
  • A first meeting bounds later mismatch only when agreement persists.
  • A coupling upper bound can exceed the exact mixing distance.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.