Sampling and Representativeness

Why Sample Means Behave Predictably

Building on the sampling TECHNIQUES covered earlier in this course, this lesson looks at the underlying STATISTICAL THEORY explaining why sample means behave so predictably. If you drew many different random samples from the same population and computed each sample's mean, those sample means would themselves form a distribution — called the sampling distribution of the mean. Even if the original population's distribution is skewed or oddly shaped, the Central Limit Theorem guarantees that this sampling distribution of the mean approaches a NORMAL distribution as sample size grows large enough (conventionally, around $n \geq 30$ is often used as a rough rule of thumb) — a remarkable and extremely useful result, since it lets researchers apply normal-distribution-based statistics even when the underlying population itself is not normally distributed.

The spread of this sampling distribution is captured by the standard error (SE): how much sample means are expected to vary from the true population mean, purely due to random sampling variation.

$$SE = \frac{\sigma}{\sqrt{n}}$$

Standard error shrinks as sample size ($n$) grows — larger samples produce more precise, less variable estimates of the population mean, which is exactly why confidence intervals (covered earlier in this course) narrow as sample size increases.

Common pitfall: confusing standard deviation (SD) with standard error (SE). Standard deviation describes the spread of INDIVIDUAL data points around the mean; standard error describes the spread of SAMPLE MEANS around the true population mean across many hypothetical samples — a related but distinct concept, and SE is always smaller than SD for the same data (since it shrinks further as sample size grows).