The Fragility of Meta-Regression Models in Observational Research

Many meta-regression analyses that synthesize estimates from primary studies have now been published in economics. Meta-regression models attempt to infer the presence of genuine empirical effects even if the authors of primary studies select statistically significant and theory-confirming estimates...

Deskribapen osoa

Gorde:
Xehetasun bibliografikoak
Argitaratua izan da:MAGKS - Joint Discussion Paper Series in Economics (Band 03-2016)
Egile nagusia: Bruns, Stefan B.
Formatua: Artikulua
Hizkuntza:ingelesa
Argitaratua: Philipps-Universität Marburg 2016
Gaiak:
Sarrera elektronikoa:PDF testu osoa
Etiketak: Etiketa erantsi
Etiketarik gabe, Izan zaitez lehena erregistro honi etiketa jartzen!
Deskribapena
Gaia:Many meta-regression analyses that synthesize estimates from primary studies have now been published in economics. Meta-regression models attempt to infer the presence of genuine empirical effects even if the authors of primary studies select statistically significant and theory-confirming estimates for publication. Meta-regression models were originally developed for the synthesis of experimental research where randomization ensures unbiased and consistent estimation of the effect of interest. Most economics research is, however, observational and authors of primary studies can search across different regression specifications for statistically significant and theory-confirming estimates. Each regression specification may possibly suffer from biases such as omitted-variable biases that result in biased and inconsistent estimation of the effect of interest. We show that if the authors of primary studies search for statistically significant and theory-confirming estimates, meta-regression models tend to systematically make false-positive findings of genuine empirical effects. The ubiquity of such search processes for specific results may limit the applicability of meta-regression models in identifying genuine empirical effects in economics.
Deskribapen fisikoa:17 Seiten
ISSN:1867-3678
DOI:10.17192/es2024.0516