Replication studies in economics How many and which papers are chosen for replication, and why?

被引:63
作者
Mueller-Langer, Frank [1 ,2 ]
Fecher, Benedikt [3 ,4 ]
Harhoff, Dietmar [2 ]
Wagner, Gert G. [3 ,4 ,5 ]
机构
[1] European Commiss, Joint Res Ctr, Digital Econ Unit, Seville, Spain
[2] Max Planck Inst Innovat & Competit, Munich, Germany
[3] Alexander von Humboldt Inst Internet & Soc, Berlin, Germany
[4] German Inst Econ Res DIW Berlin, Berlin, Germany
[5] Max Planck Inst Human Dev, Berlin, Germany
关键词
Replication; Economics of science; Science policy; Economic methodology; INTELLECTUAL PROPERTY-RIGHTS; RETAIL GASOLINE MARKETS; LEGALIZED ABORTION; VERTICAL RELATIONSHIPS; CIGARETTE CONSUMPTION; IDIOSYNCRATIC RISK; EMPIRICAL-EVIDENCE; CONTRACT CHANGES; EARNINGS LOSSES; WEEKLY PATTERN;
D O I
10.1016/j.respol.2018.07.019
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
We investigate how often replication studies are published in empirical economics and what types of journal articles are replicated. We find that between 1974 and 2014 0.1% of publications in the top 50 economics journals were replication studies. We consider the results of published formal replication studies (whether they are negating or reinforcing) and their extent: Narrow replication studies are typically devoted to mere replication of prior work, while scientific replication studies provide a broader analysis. We find evidence that higher-impact articles and articles by authors from leading institutions are more likely to be replicated, whereas the replication probability is lower for articles that appeared in top 5 economics journals. Our analysis also suggests that mandatory data disclosure policies may have a positive effect on the incidence of replication.
引用
收藏
页码:62 / 83
页数:22
相关论文
共 112 条
[61]   Information-sharing in academia and the industry: A comparative study [J].
Haeussler, Carolin .
RESEARCH POLICY, 2011, 40 (01) :105-122
[62]   Viewpoint: Replication in economics [J].
Hamermesh, Daniel S. .
CANADIAN JOURNAL OF ECONOMICS-REVUE CANADIENNE D ECONOMIQUE, 2007, 40 (03) :715-733
[63]   Replication in Labor Economics: Evidence from Data and What It Suggests [J].
Hamermesh, Daniel S. .
AMERICAN ECONOMIC REVIEW, 2017, 107 (05) :37-40
[64]   Vertical relationships and competition in retail gasoline markets: Empirical evidence from contract changes in Southern California [J].
Hastings, JS .
AMERICAN ECONOMIC REVIEW, 2004, 94 (01) :317-328
[65]   Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff [J].
Herndon, Thomas ;
Ash, Michael ;
Pollin, Robert .
CAMBRIDGE JOURNAL OF ECONOMICS, 2014, 38 (02) :257-279
[66]   Replication and Economics Journal Policies [J].
Hoeffler, Jan H. .
AMERICAN ECONOMIC REVIEW, 2017, 107 (05) :52-55
[67]  
Hung A. A., 2018, AM ECON REV, V91, P1508
[68]   The desperate need for replications [J].
Hunter, JE .
JOURNAL OF CONSUMER RESEARCH, 2001, 28 (01) :149-158
[69]   Why Science Is Not Necessarily Self-Correcting [J].
Ioannidis, John P. A. .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) :645-654
[70]   Why most published research findings are false [J].
Ioannidis, JPA .
PLOS MEDICINE, 2005, 2 (08) :696-701