Module 5: Thermodynamics and statistical physics · Lesson 5.1 · about 40 min
Microstates, entropy and the statistical ensembles
How statistical mechanics turns counting into thermodynamics: microstates and macrostates, Boltzmann and Gibbs entropy, temperature from S(E), the microcanonical, canonical and grand canonical ensembles, fluctuations, Liouville’s theorem and negative temperature.
Module 5 · about 40 minutes. By the end you will be able to count microstates, get the temperature of an isolated system from its entropy, choose the right ensemble for a problem, compute energy and particle-number fluctuations, and explain why all ensembles agree for large systems (and when they do not). Thermodynamics itself (entropy, potentials, Maxwell relations) is in the IIT JAM lessons on the second law and thermodynamic potentials; here we derive it from counting.
1. Microstates, macrostates and the basic postulate
A microstate says exactly what every particle is doing (every quantum number, or a point in phase space). A macrostate gives only a few numbers: , , , perhaps a magnetisation. The basic postulate of statistical mechanics:
- Equal a priori probabilities
- In an isolated system in equilibrium, every accessible microstate (consistent with the fixed E, V, N) is equally likely.
- Ω(E, V, N)
- the number of accessible microstates. For classical systems, the phase-space volume of the energy shell divided by h3N (and N! for identical particles).
- Physical meaning
- Macrostates are not equally likely. The one with the most microstates wins, overwhelmingly, which is why systems evolve towards equilibrium and stay there.
Worked example (spins). distinguishable spin-1/2 moments in zero field: the macrostate “ up” has microstates. For the middle one, , has , about 8% of all ; for the fluctuations about the middle are only of the total.
Einstein solid. oscillators sharing quanta: (stars and bars: arrange quanta and dividers). This one formula drives most of the counting problems examiners set.
2. Entropy and temperature from counting
Boltzmann defined
Why is this the temperature? Put two systems in thermal contact. The combined number of states is ; it is overwhelmingly peaked where . So the quantity that becomes equal in equilibrium is : that is what thermometers read.
Worked example (ideal gas from counting). For a monatomic ideal gas the phase-space volume gives . Then , so , and : the ideal gas law, with no kinetic theory at all.
The Gibbs entropy generalises Boltzmann’s to any probability distribution over microstates:
It reduces to when all , and it is largest for the uniform distribution. Maximising it with the mean energy fixed gives , the canonical distribution, with appearing as a Lagrange multiplier.
3. The three ensembles
An ensemble is an imagined collection of copies of the system, one per microstate, weighted by probability. Which one you use depends on what crosses the boundary.
| Ensemble | What is fixed | Probability of a microstate | Bridge to thermodynamics |
|---|---|---|---|
| microcanonical | |||
| canonical | |||
| grand canonical |
The canonical rule follows from the microcanonical one. A small system in contact with a huge reservoir: the probability of a system microstate of energy is proportional to the number of reservoir states left, . Expand the logarithm:
so . Let particles cross as well and the same expansion adds . The fugacity then weights each particle.
Worked example (a tiny reservoir). A two-level unit (levels , ) shares with an Einstein solid of 3 oscillators. Excited: the solid holds 3 quanta, states. Ground: 4 quanta, . So . With a huge reservoir the ratio would become exactly .
4. Fluctuations and why ensembles agree
In the canonical ensemble the energy is not fixed. Differentiating :
Both and are proportional to , so . For a monatomic gas it is exactly . Similarly, in the grand canonical ensemble
which is (Poisson statistics) for the ideal gas. Move in the figure: the distribution of energy per particle narrows to a spike.
The exception is a critical point: there or diverge, fluctuations become huge (critical opalescence) and the choice of ensemble matters for finite systems (lesson 5.7).
5. Phase space, Liouville and ergodicity
Classical microstates are points in a -dimensional phase space. Two facts make the ensemble picture consistent:
- Liouville’s theorem. Hamilton’s equations make the flow of phase points incompressible: . A uniform distribution on the energy shell stays uniform, so the microcanonical ensemble is stationary.
- Ergodic hypothesis. A single system, followed long enough, spends equal times in equal areas of its energy shell, so time averages (what we measure) equal ensemble averages (what we compute).
Counting quantum states from phase space: one state per volume per degree of freedom. For the 1D oscillator the region is an ellipse of area , giving states, in agreement with the levels . In many dimensions almost all of the volume of a ball lies in a thin outer shell (99% shell of a 100-dimensional ball: 63% of the volume), so “states below ” and “states near ” give the same entropy.
6. Negative temperature
For two-level units (levels , ) with excited, Stirling’s formula gives
rises, peaks at and falls again. Beyond the peak . This needs an energy spectrum with an upper bound (spins in a field, lasing atoms); a free gas can never do it.
Worked example. Nuclear spins with splitting meV, prepared with 60% in the upper level: , so K.
“A system at −200 K is colder than one at +300 K.” No. Heat flows from small to large , and . A negative-temperature system is hotter than any positive-temperature one: the order of hotness is K, …, , then , …, K. Order temperatures by , not by .
- ; , , . Gibbs entropy reduces to it for equal probabilities.
- Counting: for two-state units, for an Einstein solid.
- Microcanonical : . Canonical : , . Grand canonical : , .
- , ; relative fluctuations except near critical points.
- Liouville: phase-space volume is conserved; ergodicity links time and ensemble averages.
- Bounded spectra allow , which is hotter than any positive temperature.
Practise: exam questions on this lesson
They start easy and climb to top-rank level. Check each answer, then read the full solution. More on the GATE practice page.
Next: lesson 5.2, partition functions, where the canonical ensemble becomes a working tool for two-level systems, oscillators, rotors and paramagnets. fibub’s Ising model simulator shows microstates being sampled with the Boltzmann weight in real time.
Going on to CSIR NET? Fluctuations, diffusion and Brownian motion asks how far a system strays from these averages.
Check yourself
Sources
- R. K. Pathria and P. D. Beale, Statistical Mechanics, 4th ed. (Academic Press, 2021), chapters 1 to 4
- K. Huang, Statistical Mechanics, 2nd ed. (Wiley, 1987), chapters 6 and 7
- F. Reif, Fundamentals of Statistical and Thermal Physics (McGraw-Hill, 1965; reissued 2009), chapters 2 to 6
- D. V. Schroeder, An Introduction to Thermal Physics (Addison-Wesley, 2000), chapters 2, 3 and 6
- GATE Physics (PH) syllabus, Statistical Physics section, published by the organising institute each year
Your ticks stay in this browser. Save them as a file on the course home.
Updated 2026-11-22. Not affiliated with the IITs, IISc or the GATE organising institute. The general aptitude part of GATE is not covered here. Check the official GATE website for the current pattern. All questions are original.