All lessons
Data at Scale: big data, cloud and streaming, explained simply
How companies process data too big for one computer: Spark and PySpark, the Google Cloud data stack (Cloud Storage, BigQuery, Dataproc, Airflow), Druid, Bigtable and Elasticsearch, Kafka and stream processing, data platforms for AI, and retail media measurement, with animations and live problems.
What you will be able to do
- Explain when data is "big" and which tool fits which job, from one laptop to a cluster.
- Work with Spark: how it splits work, PySpark basics, and why shuffles and skew make jobs slow.
- Use the cloud data stack: a data lake on object storage, BigQuery, Dataproc and Airflow, and what each one costs.
- Pick the right database: Druid, Bigtable, Elasticsearch and the rest of the database zoo, and stream events with Kafka.
- Feed machine learning and AI, and understand the data behind retail media and advertising measurement.
Every lesson has a step-by-step animation, a plain-words meaning box, live problems with fresh numbers, a short quiz and a summary sheet to download. The course ends with mini projects and free sandboxes so you can practise without paying. Take Pipeline to Dashboard first if pipelines and warehouses are new to you.
0 of 32 lessons done
Without the tick, your progress lasts until you close this tab. Either way it stays in this browser: there is no sign-up and nothing is sent to us.