Entropy and the microcanonical ensemble
Count accessible states, define entropy and temperature, and distinguish typical behavior from a deterministic law for every small system.
On this page
The question for today
What you’ll understand
- Construct a microcanonical state count with stated macroscopic constraints.
- Derive the equilibrium condition for weakly coupled systems exchanging energy.
- Explain why thermodynamic extensivity and sharply defined temperature require appropriate limits.
A cup of gas has far more microscopic coordinates than any experiment can track. Statistical physics starts by specifying what is known, then counting the compatible microscopic possibilities. The resulting entropy describes a macroscopic constraint, rather than measuring how visually untidy one particular configuration looks. We begin with a finite two-state model because its probabilities are exactly countable. The familiar thermodynamic laws emerge when the count becomes large and sharply concentrated, under assumptions that must remain visible.
Define the ensemble before counting
An isolated system has fixed particle number, volume, and energy. In quantum mechanics, count energy eigenstates inside a narrow shell around the specified energy, including degeneracies. The shell should be narrow on a macroscopic energy scale but contain many levels when a thermodynamic description is intended. We use Boltzmann's shell entropy, rather than the alternative Gibbs entropy counting all states below the energy; their finite-system derivatives can differ. The microcanonical postulate assigns equal probabilities to accessible shell states. It is an equilibrium ensemble assumption, not a claim that every isolated initial state immediately explores every eigenstate.
For distinguishable, noninteracting two-state units, let an excitation cost energy . Exactly excitations give energy and multiplicity . The labels could refer to localized spins, so no additional division by is appropriate. Entropy is the logarithm of this multiplicity times Boltzmann's constant. Taking a logarithm turns products of independent state counts into sums, which explains why it is compatible with combining weakly interacting systems.
Energy exchange selects an entropy maximum
Put systems A and B in weak thermal contact while keeping their combined energy fixed. Negligible interaction energy lets us write the count for a chosen allocation as . The most probable allocation maximizes the sum of entropies. In a smooth large-system approximation, differentiating gives equality of their entropy slopes. Defining inverse temperature through that slope converts a counting statement into the familiar condition that bodies in thermal equilibrium have equal temperatures.
A maximum also requires suitable curvature: equality of slopes alone can describe an unstable stationary allocation. For ordinary short-range systems away from unusual constraints, concave entropy gives stable sharing. A bounded spectrum such as the two-state model can have decreasing multiplicity above half excitation, producing a negative entropy derivative and a negative absolute temperature in this definition. That population-inverted regime is possible only with an appropriate upper energy bound; it is not colder than a positive-temperature reservoir.
Typical is not certain
For macroscopic weakly correlated systems, the entropy maximum commonly overwhelms other allocations, giving reproducible bulk behavior despite microscopic motion. A six-spin example has no such overwhelming concentration: visibly different allocations retain substantial probability. The second law is therefore not a claim that every microscopic fluctuation raises entropy. Reversible microscopic equations and overwhelmingly probable macroscopic relaxation answer different questions, provided the initial preparation and coarse-graining have been specified.
Extensivity means that entropy grows proportionally to system size when energy, volume, and particle number are scaled together at fixed densities. It is a thermodynamic-limit property, not an exact identity for every finite count. Stirling corrections, boundaries, and constraints produce subleading terms. Long-range nonadditive interactions can require a different analysis. Always separate the exact finite combinatorics from a large-system approximation, and do not infer the time needed to equilibrate merely by counting equilibrium states.
Work it through
Four localized units with two excitations
Four distinguishable two-state units have exactly two excitations. Find their multiplicity and entropy, then compare with the multiplicity for one excitation.
Choosing the two excited labels gives . The energy is exactly .
The entropy is . This is the entropy of the equal-weight ensemble over the six accessible configurations.
One excitation gives and . The entropy difference is , although a four-unit finite difference is not a unique bulk temperature.
The half-excited macrostate has more compatible configurations. Individual configurations still have definite labels; the ensemble describes uncertainty under the stated energy constraint.
The living notebook
Explore the model
Interactive lab · probability
Multiplicity versus a fixed-energy constraint
Set success probability p to one half and vary the number of independent trials n. The exact binomial bars reveal the combinatorial enhancement of middle excitation counts in an unconstrained independent-spin ensemble.
- Mean · np
- 5
- Variance · np(1−p)
- 2.5
- Total probability
- 1
These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe lab shows a binomial distribution over different total energies, not a microcanonical ensemble at one fixed energy. Conditioning on one excitation count selects the corresponding fixed-energy shell; its multiplicity is the binomial coefficient.
Pause & reason
Check your understanding
Your turn
Try it yourself
Two groups contain three distinguishable two-state units each and share exactly two excitations. What are the probabilities that group A has zero, one, or two excitations?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
For each allocation, multiply the multiplicity of A by that of B, then normalize over all allocations.
Compare with the solution
The counts are , , and . Their sum is , so the probabilities are , , and . Equal energy sharing is most likely but has only 60 percent probability. The finite system illustrates why an entropy maximum need not make fluctuations negligible.
Keep the idea
Take it with you
- A microcanonical ensemble requires explicit energy-shell and accessibility assumptions.
- Temperature equality follows from maximizing the combined state count under energy exchange.
- Finite-size fluctuations and nonadditive interactions limit naive thermodynamic conclusions.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.