Practice question · Multiple choice
Comparing four groups by running a t-test on every pair means six tests. Why does that inflate the false positive rate, and what does ANOVA do instead?
Hints
- If one test has a 5% chance of a false positive, what is the chance of at least one across six?
- Ask what question ANOVA asks. How many questions is it?
Show the answer
B. Because each test carries its own 5% risk across six comparisons.
Why
Each test is fine on its own and the problem is arithmetic across tests: 0.95 to the sixth power is about 0.74, so the chance of at least one spurious result is roughly 26%. ANOVA asks one omnibus question at one alpha. It is the same multiple-comparisons problem that appears as undisclosed analytic flexibility, wearing a second costume.
Practise Statistical Tests and Correlation
The app has 7 more questions on this lesson, and keeps your place in the course. Psychology I is free to start.