The Power of Experiments: How Big is your n?

The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of...

Full description

Saved in:
Bibliographic Details
Published in:MAGKS - Joint Discussion Paper Series in Economics (Band 32-2020)
Main Authors: Asanov, Igor, Bühren, Christoph, Zacharodimou, Panagiota
Format: Article
Language:English
Published: Philipps-Universität Marburg 2020
Subjects:
Online Access:PDF Full Text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the Journal of Economic Behavior and Organization, we observe that we did not learn much from this debate. The median experiment in our sample has too few independent observations and, thus, is underpowered. Moreover, we find indications for biases in reporting highly significant results. We investigate for which papers and experiments it is more likely to find reporting biases, and we suggest remedies that could help to overcome the replicability crisis.
Physical Description:33 Pages
ISSN:1867-3678
DOI:10.17192/es2024.0658