Practice question · Put in order
Order the steps of guarding an observational study against observer bias.
- Compute their inter-rater reliability to check agreement
- Have them all code the same behavior separately
- Train several independent observers on the same coding scheme
- Recognize that an observer's expectations could shape what they notice
Hints
- You cannot compute agreement before independent observers have each coded the behavior.
- The reliability check is the final verification step.
Show the answer
- Recognize that an observer's expectations could shape what they notice
- Train several independent observers on the same coding scheme
- Have them all code the same behavior separately
- Compute their inter-rater reliability to check agreement
Why
Acknowledge the bias, train independent observers, have them code separately, then compute inter-rater reliability. Agreement can only be measured after multiple observers have independently rated the same behavior - the check is the last step.
Practise Observation and Surveys
The app has 4 more questions on this lesson, and keeps your place in the course. Psychology I is free to start.
More questions on Observation and Surveys
- The face-to-face figure is the better estimate of a stigmatised behaviour, because people answer more…
- A survey achieves a 12% response rate from a perfectly drawn random sample. Why does the careful sampling not…
- Select every statement that is TRUE.
- Naturalistic observation watches behaviour where it normally happens; structured observation stages the…
- Sort each described study by observation method.
- Even a well-designed survey does not simply capture what people think and do. What gets in the way?