Getting Findings Into the World, Honestly
Once a study is complete, findings must be written up and shared so other researchers can evaluate, build on, or attempt to replicate them. Psychology conventionally follows APA style, structuring a research report into standard sections: an abstract (a brief summary), an introduction (background and hypotheses), a method section (exactly how the study was conducted, detailed enough to be replicated), a results section (the statistical findings), and a discussion (interpretation, limitations, and implications).
Before publication, most reputable psychology journals use peer review: independent experts in the field evaluate a submitted manuscript's methods, analysis, and conclusions, often requesting revisions or rejecting work that does not meet the field's standards. Peer review is an imperfect but important quality filter, catching many (though not all) methodological problems before they reach publication.
A persistent structural problem is publication bias: studies finding a statistically significant, "positive" result are considerably more likely to be published than studies finding a null result, even when the null-result studies were just as well-designed. This creates the so-called file-drawer problem — an unknown number of well-conducted null-result studies sitting unpublished in researchers' file drawers, skewing the published literature toward appearing more consistent and positive than the underlying reality.
| Section | Content |
|---|---|
| Abstract | Brief summary of the whole study |
| Introduction | Background, theory, hypotheses |
| Method | Exactly how the study was conducted |
| Results | Statistical findings |
| Discussion | Interpretation, limitations, implications |
Recent reforms directly target these problems: preregistration (publicly registering hypotheses and analysis plans before data collection, discussed earlier in this course) helps prevent selective reporting, while open-access publishing and open-data sharing let other researchers scrutinize and reuse study materials directly, rather than relying solely on a journal's summary.
Common pitfall: treating a peer-reviewed publication as automatically "proven true." Peer review checks for methodological soundness and improves overall quality, but it does not guarantee a finding is correct — replication, not the mere fact of publication, is what ultimately builds confidence in a result.