Module 1: Mathematical physics · Lesson 1.10 · about 60 min
Probability and statistics for physicists
Rules of probability, conditional probability and Bayes' theorem, counting (including identical particles), the binomial, Poisson, Gaussian, uniform and exponential distributions, moments and characteristic functions, random walks and the central limit theorem, counting statistics, propagation of errors, weighted means, least squares and chi-square.
Module 1 · about 60 minutes. By the end you will be able to use conditional probability and Bayes’ theorem, count configurations of distinguishable and identical particles, work with the binomial, Poisson, Gaussian, uniform and exponential distributions and know when one approximates another, handle random walks and the central limit theorem, and treat data the way an experimental physicist does: counting errors, error propagation, weighted means, least-squares lines and chi-square. This lesson closes the mathematical physics module and prepares the ground for statistical mechanics.
1. Rules of probability
For events and : and . They are independent if , i.e. . Mutually exclusive events () are the opposite of independent: if one happens, the other cannot.
Bayes’ theorem turns into :
Worked example. 1% of samples are contaminated; a test catches 99% of contaminated ones and falsely flags 5% of clean ones. . Most alarms are false, because clean samples are 99 times more common.
Counting. Arrangements of distinguishable objects: ; choices of from : . For particles in single-particle states: distinguishable ; identical bosons (any occupation); identical fermions (at most one per state). Three bosons in three states: 10 configurations; distinguishable: 27; fermions: 1. These counts become Bose–Einstein and Fermi–Dirac statistics. For large , Stirling: (the full form is good to about ).
2. Mean, variance and moments
For a discrete variable ; for a continuous one . The variance . Rules that hold always: , and
with for independent variables (the converse is false: with symmetric has zero covariance). So for independent copies the variance of the sum is and the standard error of the mean is .
The characteristic function is the Fourier transform of ; , moments are its derivatives at 0, and for a sum of independent variables the s multiply.
- σ (standard deviation)
- the typical size of the spread about the mean; the square root of the variance
- Standard error
- the spread of a mean of N values, σ/√N
- Poisson process
- independent rare events at a constant average rate, such as decays or photon arrivals
- Weight 1/σ²
- how much a measurement counts in an average; twice as precise means four times the weight
- χ²/ν
- the average squared misfit per degree of freedom, in units of the error bars; about 1 for a good fit
- Physical meaning
- Fluctuations shrink relative to the mean as 1/√N. That is why a gas of 10²³ molecules has a sharp pressure, and why longer counting gives better rates.
3. The distributions you need
| distribution | formula | mean | variance | where it appears |
|---|---|---|---|---|
| binomial | yes/no trials, spins up or down | |||
| Poisson | counts of rare independent events | |||
| Gaussian | sums of many small effects, measurement errors | |||
| uniform on | rounding errors, random phases | |||
| exponential | waiting times, lifetimes |
Facts examiners like:
- Gaussian: 68.3% within , 95.4% within , 99.7% within ; one tail beyond holds 2.3%. FWHM . , . With fixed mean and variance it has the largest entropy.
- Poisson: , (so the mode is ), sums of independent Poissons are Poisson, and detecting each event with probability gives Poisson with mean .
- Exponential: no memory; the median (half-life) is , below the mean ; the probability of decaying between and is .
Limits. Binomial with , , fixed: Poisson. Binomial or Poisson with large mean: Gaussian with the same mean and variance. The figure lets you watch both limits happen.
Worked example. Two independent sources give 2 and 3 counts per second on average. , because the total is Poisson with mean 5.
4. Random walks and the central limit theorem
A walker takes independent steps of length , right with probability . Each step has mean and variance , so after steps
For a fair walk, but : 100 steps of 1 m spread only 10 m. With this is diffusion, , and the distribution of becomes the heat kernel of lesson 1.8.
The central limit theorem says this is general: the sum of many independent, identically distributed variables with finite variance is approximately Gaussian, whatever the individual distribution. (A Lorentzian has no variance and is the classic exception: averaging Lorentzian data does not narrow it.)
5. Treating data
Counting. counts have , so 1% precision needs counts. For a net rate , variances add even though you subtract: .
Propagation of independent errors.
Worked example. , , : . fibub’s Uncertainty propagation calculator does this for any formula.
Weighted mean. Measurements combine with weights : , . and give .
Least squares and chi-square. For with equal errors, minimising gives
so the line passes through . With known errors, ; for degrees of freedom (points minus fitted parameters) a good fit has . Much larger means a bad model or underestimated errors; much smaller means overestimated errors.
“Subtracting two measurements cancels their errors.” The values subtract; the uncertainties do not. For independent quantities, , so a small difference of two large, noisy numbers can be very uncertain. That is why weak signals on a big background need long counting times, and why is the wrong error for a net count of 300.
- Independence: . Bayes: ; rare causes give mostly false alarms.
- Bosons , fermions , distinguishable . .
- Binomial , ; Poisson , ; uniform ; exponential mean , median ; Gaussian 68/95/99.7, FWHM , .
- Variances of independent quantities add: , , . Biased walk: .
- Errors in quadrature with partial derivatives; powers multiply relative errors. Weighted mean with . Least-squares line through ; .
Practise: exam questions on this lesson
From warm-up to top-rank level, with full solutions. More on the probability practice page.
Try the Binomial lab, the Normal lab and the Counting statistics helper. Before this: lesson 1.9, tensors. Next: Part B begins with Lagrangian mechanics; meanwhile, quantum measurement probabilities are in lesson 4.1. Back to the GATE Physics course home.
Going on to CSIR NET? Random variables and probability distributions and measurement, errors and fitting data take these ideas into Part C.
Check yourself
Sources
- P. R. Bevington and D. K. Robinson, Data Reduction and Error Analysis for the Physical Sciences, 3rd ed. (2003), chapters 1 to 6
- J. R. Taylor, An Introduction to Error Analysis, 2nd ed. (1997), chapters 3 to 8
- F. Reif, Fundamentals of Statistical and Thermal Physics (1965), chapter 1
- M. L. Boas, Mathematical Methods in the Physical Sciences, 3rd ed. (2006), chapter 15
- GATE Physics (PH) syllabus, Mathematical Physics section, published by the organising institute each year
Your ticks stay in this browser. Save them as a file on the course home.
Updated 2026-11-22. Not affiliated with the IITs, IISc or the GATE organising institute. The general aptitude part of GATE is not covered here. Check the official GATE website for the current pattern. All questions are original.