The Power of Experiments: How Big is your n?

The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of...

Full beskrivning

Sparad:
Bibliografiska uppgifter
I publikationen:MAGKS - Joint Discussion Paper Series in Economics (Band 32-2020)
Huvudupphovsmän: Asanov, Igor, Bühren, Christoph, Zacharodimou, Panagiota
Materialtyp: Artikel
Språk:engelska
Publicerad: Philipps-Universität Marburg 2020
Ämnen:
Länkar:PDF-fulltext
Taggar: Lägg till en tagg
Inga taggar, Lägg till första taggen!
Beskrivning
Sammanfattning:The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of Economic Behavior and Organization, we observe that we did not learn much from this debate. The median experiment in our sample has too few independent observations and, thus, is underpowered. Moreover, we find indications for biases in reporting highly significant results. We investigate for which papers and experiments it is more likely to find reporting biases, and we suggest remedies that could help to overcome the replicability crisis.
Fysisk beskrivning:33 Seiten
ISSN:1867-3678
DOI:10.17192/es2024.0658