Detailed balance and time reversal
Distinguish edge-by-edge detailed balance from global stationarity, use cycle products to diagnose driving, and relate reversible path statistics to the parity of observed variables.
On this page
The question for today
What you’ll understand
- Compute stationary edge currents in a finite-state Markov model.
- Test detailed balance rather than infer it from a time-independent distribution.
- State the variable and protocol transformations required for physical time reversal.
A stationary population can hide ongoing cycles of transitions. Detailed balance is stronger: each transition channel is balanced by its reverse in the stationary ensemble. This distinction explains how a system can maintain unchanged state probabilities while dissipating energy. We will use small Markov networks to make the difference calculable, then state the limits of interpreting a simple reversal of recorded labels as a physical time-reversed experiment.
Balance each edge or only each node
Let be a continuous-time transition rate from state i to state j, with units of inverse seconds. For probabilities p, define the oriented edge current . The master equation adds incoming and subtracts outgoing currents at each node. A stationary distribution pi makes every node's total accumulation vanish. Detailed balance instead requires on every connected pair. Equal total inflow and outflow need not mean equal flow on each edge.
In a two-state network with both rates positive, stationarity forces the only edge current to zero, so the stationary chain obeys detailed balance. At least one cycle is needed to sustain an independent stationary circulation in such a finite-state model. For a three-state ring, clockwise currents can enter and leave each node at the same rate, preserving all populations. The absence of population change then says nothing about whether forward and reverse transitions are individually balanced. Counting transitions as well as occupations reveals the hidden motion.
A cycle ratio detects irreversibility
Multiplying detailed-balance relations around a closed cycle cancels the stationary probabilities. The product of forward rates must equal the product of reverse rates. Conversely, on an irreducible finite graph with bidirectional edges, satisfying this condition on all cycles allows a consistent reversible stationary distribution to be constructed. The logarithm of the product ratio is a dimensionless cycle affinity. A nonzero value rules out detailed balance even when the stationary probabilities are known exactly and appear symmetric.
For a thermally consistent transition model, local detailed balance relates log rate ratios to energy and reservoir entropy exchanges. A cycle affinity can then represent a chemical or mechanical driving force divided by thermal energy. Purely assigning a Markov matrix does not automatically specify that thermodynamic interpretation. Without energies, reservoirs, and coupling assumptions, the cycle test diagnoses stochastic irreversibility, while an actual heat or fuel consumption rate requires more physical information. This separation prevents a convenient mathematical chain from being mistaken for a fully calibrated thermodynamic machine.
Reverse the right physical variables
For states representing positions or other time-even variables and time-independent reversible dynamics, detailed balance equates stationary probabilities of a path and its reversed sequence. If velocities are included, physical time reversal also changes their signs. Magnetic fields or moving boundary protocols may require corresponding reversals. Simply playing a movie backward without transforming the appropriate external controls is not the same experiment. The mathematical definition of a reverse path must match the physical parity and the chosen dynamics.
Reversibility is also distinct from convergence to stationarity. A discrete chain that alternates deterministically between two states obeys detailed balance with equal stationary weights, yet an ensemble started in one state never converges to those weights. Aperiodicity or appropriate continuous-time assumptions are needed for relaxation. These qualifications matter when a laboratory instrument uses discrete transitions while a physical model uses continuous rates. Both can teach balance, but their transition parameters, clock units, and convergence behavior must not be silently identified.
Work it through
A two-state process with balanced traffic
A continuous-time system has rates and . Find its stationary probabilities, forward and reverse edge traffic, and the relaxation rate of a probability perturbation.
Stationarity requires , and normalization requires . Thus and .
The two directed stationary traffic rates are and . Their difference is zero even though transitions continue occurring.
Writing gives . A deviation from its stationary value therefore decays at rate , with a relaxation time of one-quarter second.
The stationary weights are one-quarter and three-quarters, edge traffic is balanced at 0.75 per second in each direction, and perturbations relax at 4 per second.
The living notebook
Explore the model
Interactive lab · markov
Equal stationary weights can have different relaxation
Reset and set BOTH Transition p = 0.3 and Transition q = 0.1; predict stationary probabilities (0.25, 0.75). For a fresh comparison, Reset and set p = 0.6 and q = 0.2; predict the same stationary law but faster convergence. Step once and compare state-1 probabilities 0.3 and 0.6.
- P(state 1) at step 0
- 0%
- Stationary P(state 1)
- 60%
- Chain behavior
- Monotone convergence
Exact finite-step probabilities for a two-state chain starting in state 0, not sampled trajectories. Playback advances two transitions per second. When p = q = 0 every distribution is stationary; when p = q = 1 the chain alternates forever. A single zero transition creates an absorbing state. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThis instrument uses discrete transition probabilities and starts in state 0. It illustrates balance and relaxation but has only two states, so it cannot exhibit a driven three-state cycle or measure heat.
Pause & reason
Check your understanding
Your turn
Try it yourself
Three states form a ring. Every clockwise edge has rate and every counterclockwise edge rate . Show that the uniform distribution is stationary, then find each clockwise net edge current and the cycle affinity.
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
At each node there is one incoming edge of each rate and one outgoing edge of each rate. Apply the product-ratio test separately from that node balance.
Compare with the solution
With , each node's total inflow and outflow is , so the distribution is stationary. Each clockwise oriented current is . The cycle affinity is , which is nonzero. Thus stationary uniform occupations coexist with irreversible circulation, and detailed balance fails despite exact node-by-node conservation.
Keep the idea
Take it with you
- Stationarity balances nodes; detailed balance balances every reversible edge.
- A nonzero cycle affinity detects driving hidden by stationary occupations.
- Time reversal must transform odd variables and relevant external protocols consistently.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.