Replication studies in economics How many and which papers are chosen for replication, and why?

被引:63
作者
Mueller-Langer, Frank [1 ,2 ]
Fecher, Benedikt [3 ,4 ]
Harhoff, Dietmar [2 ]
Wagner, Gert G. [3 ,4 ,5 ]
机构
[1] European Commiss, Joint Res Ctr, Digital Econ Unit, Seville, Spain
[2] Max Planck Inst Innovat & Competit, Munich, Germany
[3] Alexander von Humboldt Inst Internet & Soc, Berlin, Germany
[4] German Inst Econ Res DIW Berlin, Berlin, Germany
[5] Max Planck Inst Human Dev, Berlin, Germany
关键词
Replication; Economics of science; Science policy; Economic methodology; INTELLECTUAL PROPERTY-RIGHTS; RETAIL GASOLINE MARKETS; LEGALIZED ABORTION; VERTICAL RELATIONSHIPS; CIGARETTE CONSUMPTION; IDIOSYNCRATIC RISK; EMPIRICAL-EVIDENCE; CONTRACT CHANGES; EARNINGS LOSSES; WEEKLY PATTERN;
D O I
10.1016/j.respol.2018.07.019
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
We investigate how often replication studies are published in empirical economics and what types of journal articles are replicated. We find that between 1974 and 2014 0.1% of publications in the top 50 economics journals were replication studies. We consider the results of published formal replication studies (whether they are negating or reinforcing) and their extent: Narrow replication studies are typically devoted to mere replication of prior work, while scientific replication studies provide a broader analysis. We find evidence that higher-impact articles and articles by authors from leading institutions are more likely to be replicated, whereas the replication probability is lower for articles that appeared in top 5 economics journals. Our analysis also suggests that mandatory data disclosure policies may have a positive effect on the incidence of replication.
引用
收藏
页码:62 / 83
页数:22
相关论文
共 112 条
[1]   Taxes, Cigarette Consumption, and Smoking Intensity: Comment [J].
Abrevaya, Jason ;
Puzzello, Laura .
AMERICAN ECONOMIC REVIEW, 2012, 102 (04) :1751-1763
[2]   Taxes, cigarette consumption, and smoking intensity [J].
Adda, Jerome ;
Cornaglia, Francesca .
AMERICAN ECONOMIC REVIEW, 2006, 96 (04) :1013-1028
[3]  
Anderson LR, 1997, AM ECON REV, V87, P847
[4]   The role of data/code archives in the future of economic research [J].
Anderson, Richard ;
Greene, William ;
McCullough, B. ;
Vinod, H. .
JOURNAL OF ECONOMIC METHODOLOGY, 2008, 15 (01) :99-119
[5]   Replication, Meta-Analysis, and Research Synthesis in Economics [J].
Anderson, Richard G. ;
Kichkha, Areerat .
AMERICAN ECONOMIC REVIEW, 2017, 107 (05) :56-59
[6]   Open access to data: An ideal professed but not practised [J].
Andreoli-Versbach, Patrick ;
Mueller-Langer, Frank .
RESEARCH POLICY, 2014, 43 (09) :1621-1633
[7]  
Angrist J., 2017, Inside job or deep impact? Using extramural citations to assess economic scholarship
[8]  
[Anonymous], 1975, J POLIT ECON, V83, P1295
[9]  
[Anonymous], 2012, How economics shapes science
[10]  
[Anonymous], 2012, Flawed science: The fraudulent research practices of social psychologist Diederik Stapel, DOI http://hdl.handle.net/11858/