Psychology I / Statistical Tests and Correlation
Practice question · Multiple choice

Comparing four groups by running a t-test on every pair means six tests. Why does that inflate the false positive rate, and what does ANOVA do instead?

Hints
  1. If one test has a 5% chance of a false positive, what is the chance of at least one across six?
  2. Ask what question ANOVA asks. How many questions is it?
Show the answer

B. Because each test carries its own 5% risk across six comparisons.

Why

Each test is fine on its own and the problem is arithmetic across tests: 0.95 to the sixth power is about 0.74, so the chance of at least one spurious result is roughly 26%. ANOVA asks one omnibus question at one alpha. It is the same multiple-comparisons problem that appears as undisclosed analytic flexibility, wearing a second costume.

Read the lesson: Statistical Tests and Correlation →

Practise Statistical Tests and Correlation

The app has 7 more questions on this lesson, and keeps your place in the course. Psychology I is free to start.

More questions on Statistical Tests and Correlation