Module 2: Mathematical methods · Lesson 2.3 · about 50 min
Random variables and probability distributions
Random variables, mean, variance and moments; the binomial, Poisson, Gaussian, uniform, exponential and Cauchy distributions and the limits that connect them; counting statistics, random walks and the central limit theorem; changing variables, characteristic functions and cumulants; Bayes' theorem and covariance.
Module 2 · about 50 minutes. By the end you will be able to compute means, variances and probabilities for the standard distributions, know when one turns into another, handle counting statistics and random walks, change variables in a probability density, and use characteristic functions and Bayes’ theorem. NET puts one or two of these in Part C and many more in Part A.
1. Random variables, mean and variance
A random variable takes values with probabilities (discrete) or a density (continuous), normalised to 1. Averages are weighted sums:
Rules that save time: ; ; for independent variables and variances add, for sums and differences alike. The covariance is zero for independent variables, but zero covariance does not prove independence (take with symmetric about 0).
Worked example. Uniform on : , , so .
2. The standard distributions
| Distribution | Formula | Mean | Variance | Where it appears |
|---|---|---|---|---|
| binomial | yes/no trials | |||
| Poisson | counts of rare independent events | |||
| Gaussian | sums of many small effects | |||
| exponential | waiting times, lifetimes | |||
| uniform | random phases | |||
| Cauchy | undefined | infinite | natural line shapes |
- λ
- the mean number of events in the interval (Poisson), or the rate (exponential)
- σ
- the standard deviation: the typical spread about the mean
- √N
- the counting uncertainty: N counts carry an uncertainty √N, a fraction 1/√N
- FWHM
- full width at half maximum: 2√(2 ln 2) σ ≈ 2.355σ for a Gaussian, 2γ for a Lorentzian
- Physical meaning
- The Poisson law is what you get when many independent nuclei or photons each have a tiny chance to register. Its spread equals its mean, which sets the shot noise of every counting experiment.
The two limits. For large and small with fixed, the binomial becomes Poisson. For large mean (, or ), both become Gaussian with the same mean and variance. The Gaussian gives the familiar 68%, 95.5% and 99.7% within , , .
Worked example. 1000 nuclei, each decaying in a minute with probability 0.002. With : , , . The exact binomial differs only in the fourth decimal place.
3. Counting statistics and the random walk
The waiting time between events of a Poisson process is exponential, and it has no memory: . That is why a radioactive nucleus has a half-life independent of its age.
A random walk of independent steps of length , each equally likely forward or back, has
With a bias (probability forward, back) the mean drifts as and the variance is . Since , : this is diffusion. The probability of ending at (in units of ) is binomial, for the unbiased walk.
The central limit theorem. The sum of independent, identically distributed variables with finite variance tends to a Gaussian with variance ; their mean has standard deviation . It fails for the Cauchy distribution (no finite variance).
Worked example. Single readings scatter with mm. To get the mean to mm you need readings.
4. Changing variables, moments and characteristic functions
If is one-to-one, probability is conserved in matching intervals: , so
summed over every that gives the same . Example: uniform on and gives . For with Gaussian, both roots count, giving the density with one degree of freedom.
The characteristic function is the Fourier transform of the density. Its Taylor coefficients are the moments, and those of are the cumulants ( = mean, = variance). For independent variables, cumulants add.
| Distribution | Cumulants | |
|---|---|---|
| Gaussian | only , | |
| Poisson | all | |
| Cauchy | none defined |
Gaussian moments are worth memorising: for zero mean, so , and .
5. Conditional probability and Bayes’ theorem
Worked example. A detector flags a rare event type (1% of events) with probability 0.99, and wrongly flags 1% of ordinary events. Then . Half the flags are false, because the background is 99 times more common.
“Variances subtract for a difference.” They never do: for independent , , which is why background subtraction makes a signal noisier. A second classic slip: the most probable value, the mean and the median are different numbers for skewed distributions (Maxwell speeds: ), and a Poisson count of mean 3 has only a 22% chance of being exactly 3.
- ; ; independent variances add for sums and differences.
- Binomial , ; Poisson , ; exponential , ; uniform ; Cauchy has no variance.
- Binomial → Poisson (small , fixed) → Gaussian (large mean). 68 / 95.5 / 99.7% within 1, 2, 3 σ; FWHM = 2.355σ.
- Counting: uncertainty . Random walk: . Mean of readings: .
- Change of variables: , summed over all roots.
- ; Gaussian cumulants stop at 2; Poisson cumulants all equal .
- Bayes: posterior ∝ likelihood × prior; rare events need very low false-alarm rates.
Practise: exam questions on this lesson
They start easy and climb to top-rank level. More on the practice page.
Before this: lesson 2.2, group theory. Next: lesson 2.4, numerical methods. The same distributions return in statistical physics: see the GATE lesson on ensembles and the kinetic theory lesson for the Maxwell distribution.
Check yourself
Sources
- M. L. Boas, Mathematical Methods in the Physical Sciences, 3rd ed. (2006), chapter 15
- F. Reif, Fundamentals of Statistical and Thermal Physics (1965), chapter 1
- P. R. Bevington and D. K. Robinson, Data Reduction and Error Analysis for the Physical Sciences, 3rd ed. (2003), chapters 2 and 3
- CSIR-UGC NET Physical Sciences syllabus, Mathematical Methods of Physics (probability and random variables)
Your ticks stay in this browser. Save them as a file on the course home.
Updated 2026-11-22. Not affiliated with CSIR, UGC or the National Testing Agency. Check the official CSIR NET website for the current pattern. All questions are original.