The Power of Experiments: How Big is your n?

The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of...

Täydet tiedot

Tallennettuna:
Bibliografiset tiedot
Julkaisussa:MAGKS - Joint Discussion Paper Series in Economics (Band 32-2020)
Päätekijät: Asanov, Igor, Bühren, Christoph, Zacharodimou, Panagiota
Aineistotyyppi: Artikkeli
Kieli:englanti
Julkaistu: Philipps-Universität Marburg 2020
Aiheet:
Linkit:PDF-kokoteksti
Tagit: Lisää tagi
Ei tageja, Lisää ensimmäinen tagi!
Kuvaus
Yhteenveto:The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of Economic Behavior and Organization, we observe that we did not learn much from this debate. The median experiment in our sample has too few independent observations and, thus, is underpowered. Moreover, we find indications for biases in reporting highly significant results. We investigate for which papers and experiments it is more likely to find reporting biases, and we suggest remedies that could help to overcome the replicability crisis.
Ulkoasu:33 Seiten
ISSN:1867-3678
DOI:10.17192/es2024.0658