Home / Learn / Data & AI / Statistics for analysts
All lessons

Statistics for analysts: from averages to A/B tests

The statistics data and BI analysts use every week: describing data, probability, distributions, sampling, confidence intervals, hypothesis tests and A/B testing, with simulations you can play with and every formula worked by hand.

For analysts, students and career changers. School maths is enough; each formula is explained symbol by symbol. Free, no sign-up. All 50 lessons, about 19.4 hours.

What you will be able to do

  • Describe any dataset honestly: pick the right average, measure spread, spot skew and outliers, and say where one value stands.
  • Reason with chance: conditional probability, Bayes, expected value and the distributions behind counts, waiting times and money.
  • Go from a sample to the truth: standard errors, confidence intervals, the bootstrap and how big a sample you need.
  • Test ideas: t-tests, chi-square, ANOVA and rank tests, what a p-value means, power, and the traps of many tests at once.
  • Run and read A/B tests like a product analyst: design, sample size, peeking, sample ratio mismatch and a written decision.

Every lesson has a picture or simulation, a maths box with a worked example, practice questions and a short quiz. You finish with an experiment readout, a one-page decision memo built from a realistic A/B test, ready for your portfolio. Statistics links to the machine learning course From a straight line to an LLM, which covers fitting models, and to fibub's free statistics tools for your own data.

0 of 50 lessons done

Without the tick, your progress lasts until you close this tab. Either way it stays in this browser: there is no sign-up and nothing is sent to us.

All modules

Part A: Describing data and chance

1 Describing data 5 lessons

  1. 1.1 Why analysts need statistics
  2. 1.2 The centre: mean, median and mode
  3. 1.3 The spread: range, variance, standard deviation and IQR
  4. 1.4 Shape, skew and outliers: reading a box plot
  5. 1.5 Percentiles and z-scores: where one value stands

2 Probability for decisions 4 lessons

  1. 2.1 Probability rules with pictures
  2. 2.2 Conditional probability and Bayes: the base-rate trap
  3. 2.3 Expected value: is the promotion worth it?
  4. 2.4 Counting: combinations and permutations

3 Distributions 6 lessons

  1. 3.1 Random variables and distributions
  2. 3.2 The binomial: how many of n say yes
  3. 3.3 The Poisson: orders per hour and rare events
  4. 3.4 The normal distribution and its areas
  5. 3.5 Waiting times and money: exponential and log-normal
  6. 3.6 Which distribution fits your data

Part B: From a sample to the truth

4 Samples 5 lessons

  1. 4.1 Populations and samples
  2. 4.2 Bias: survivorship, selection and non-response
  3. 4.3 The central limit theorem
  4. 4.4 Standard error: how much a sample result wobbles
  5. 4.5 The bootstrap: resampling your own data

5 Estimation 4 lessons

  1. 5.1 Confidence intervals for a mean
  2. 5.2 Confidence intervals for a proportion
  3. 5.3 What "95 % confident" really means
  4. 5.4 How big a sample do you need?

6 Hypothesis tests 9 lessons

  1. 6.1 The logic of a test: null, alternative and evidence
  2. 6.2 P-values: what they are and what they are not
  3. 6.3 t-tests: one sample, two samples and paired
  4. 6.4 Type I and type II errors, and power
  5. 6.5 Chi-square tests for categories
  6. 6.6 ANOVA: comparing three or more groups
  7. 6.7 When the data is not normal: rank tests
  8. 6.8 Many tests at once: the multiple comparisons trap
  9. 6.9 Effect size: significant is not the same as important

Part C: Statistics at work

7 A/B testing 8 lessons

  1. 7.1 Designing an A/B test
  2. 7.2 Choosing metrics: primary, secondary and guardrails
  3. 7.3 Sample size and how long to run
  4. 7.4 The peeking problem
  5. 7.5 Reading a conversion test from start to finish
  6. 7.6 Sample ratio mismatch: when the split is broken
  7. 7.7 The Bayesian view of an A/B test
  8. 7.8 Novelty effects, interference and when not to test

8 Relationships and business data 6 lessons

  1. 8.1 Correlation: Pearson and Spearman
  2. 8.2 Regression for explaining: coefficients, intervals and p-values
  3. 8.3 Confounding and Simpson's paradox
  4. 8.4 Time series: trend, seasonality and moving averages
  5. 8.5 Simple forecasting and its uncertainty
  6. 8.6 Control charts: is this KPI drop real?

9 Capstone and interviews 3 lessons

  1. 9.1 Capstone: an experiment readout
  2. 9.2 Statistics interview questions, answered
  3. 9.3 Which test when: a one-page guide