Learn Statistics

Statistics is the branch of mathematics dedicated to collecting, organizing, analyzing, and interpreting data so that people can make informed decisions in the face of uncertainty.

What Is Statistics?

Statistics is the science of turning raw data into understanding. It gives you a toolkit for collecting numbers, organizing them, summarizing them into a few meaningful values, and drawing conclusions that go beyond the specific numbers you happened to measure.

Imagine a coffee shop owner who wants to know how long customers wait in line during the morning rush. She could stand there with a stopwatch and note down every wait time for a week. Statistics gives her the tools to summarize that pile of numbers - for example, the average wait was 4.2 minutes - and to decide whether that is a problem worth fixing.

  • Descriptive statistics: organizing and summarizing data you already have, using tools such as averages, charts, and tables.
  • Inferential statistics: using a smaller sample of data to draw conclusions or make predictions about a much larger group you did not fully measure.

Population vs Sample

A population is every single member of the group you care about, while a sample is a smaller subset of that population that you actually measure. A university with 50,000 students is a population; if you survey 200 of those students about their commute time, those 200 responses are your sample.

ScenarioPopulationSample
University commute surveyAll 50,000 enrolled students200 students who filled out the survey
Factory quality checkEvery light bulb produced this month300 bulbs pulled off the line for testing
National election pollAll eligible voters in the country1,500 voters contacted by phone

Example

import statistics

# A sample of 5 exam scores out of 100
sample_scores = [72, 85, 90, 68, 77]

sample_mean = statistics.mean(sample_scores)
print("Sample mean:", sample_mean)
# Sample mean: 78.4
Note: You almost never measure an entire population - it is too slow or too expensive. Instead, statisticians carefully choose a sample and use inferential statistics to estimate what is happening in the full population, along with how confident they are in that estimate.

Why Statistics Matters

  • Medicine: clinical trials use statistics to decide whether a new drug actually works better than a placebo.
  • Business: companies run A/B tests on website designs and use statistics to decide which version sells more.
  • Manufacturing: quality control teams sample products off the line to catch defects before they reach customers.
  • Weather and sports: forecasts and player ratings are built from statistical models trained on historical data.
Note: In the next lessons you will learn how to classify data (numerical vs categorical), and then how to summarize a dataset using the mean, median, mode, variance, and standard deviation - the core building blocks of descriptive statistics.

Exercise: Statistics Introduction

What is the main difference between descriptive and inferential statistics?

Frequently Asked Questions

Do I need statistics if I only want to do machine learning?
Yes. Without it you cannot tell a real improvement from noise, judge whether a sample represents anything, or explain why a model fails on new data. Most machine learning mistakes are statistical mistakes wearing a technical disguise.
What is the difference between mean and median?
The mean adds every value and divides by the count. The median is the middle value when sorted. When a few extreme values distort the picture, as with salaries or house prices, the median describes a typical case far better.
What does statistical significance actually mean?
That a result is unlikely to have arisen by chance alone, given your assumptions. It says nothing about whether the effect is large or useful. A tiny, meaningless difference becomes statistically significant with a big enough sample.
What is the difference between correlation and causation?
Correlation says two things move together. Causation says one produces the other. Correlation can arise from coincidence or from a third factor driving both, which is why an experiment, not a stronger correlation, is what establishes cause.