James's Math Hub
Statistics & Probability

Lesson 7 / 13 · 11 min read

The Normal Distribution

The bell curve, the 68-95-99.7 rule, and z-scores.

The bell curve

The normal distribution (a.k.a. Gaussian) is the famous bell-shaped curve. It's defined by two numbers:

  • Mean μ\mu — where the peak is.
  • Standard deviation σ\sigma — how wide the bell is.

It shows up everywhere: heights, test scores, measurement errors, sums of many small random effects.

The 68-95-99.7 rule

For any normal distribution, the percentage of data within kk standard deviations of the mean is:

RangePercent of data
μ±1σ\mu \pm 1\sigma~68%
μ±2σ\mu \pm 2\sigma~95%
μ±3σ\mu \pm 3\sigma~99.7%

Example. SAT scores are roughly normal with μ=1050\mu = 1050, σ=200\sigma = 200.

  • About 68% of test-takers score between 850850 and 12501250.
  • About 95% score between 650650 and 14501450.
  • About 99.7% score between 450450 and 16501650.

Z-scores

A z-score tells you how many standard deviations a value is from the mean:

z=xμσz = \frac{x - \mu}{\sigma}

A positive zz means above the mean; negative means below.

Example. SAT μ=1050\mu = 1050, σ=200\sigma = 200. If you score 13501350:

z=13501050200=300200=1.5z = \frac{1350 - 1050}{200} = \frac{300}{200} = 1.5

You're 1.5 standard deviations above the mean.

Why z-scores matter

Z-scores let you compare values across different normal distributions on a common scale. A score of "z=2z = 2" on the SAT and "z=2z = 2" on the ACT both mean "roughly the top 2.5%" regardless of the original units.

Standard normal table (rough values)

For the standard normal (mean 0, std dev 1), the proportion of data below a given zz:

zzP(Z<z)P(Z < z)
2-22.3%
1-115.9%
0050%
1184.1%
2297.7%

So if your z=1.5z = 1.5, you scored higher than about 93% of test-takers.

Key takeaways

  • The normal distribution is fully described by mean and standard deviation.
  • 68% within 1 SD, 95% within 2 SDs, 99.7% within 3 SDs.
  • Z-scores rescale anything to "how many SDs from average" — letting you compare across distributions.