Standard Operating Procedures: A Safety Net for Pre-Analysis Plans

被引:44
作者
Lin, Winston [1 ]
Green, Donald P. [1 ]
机构
[1] Columbia Univ, Polit Sci, New York, NY 10027 USA
关键词
POLITICAL-SCIENCE; PUBLICATION BIAS;
D O I
10.1017/S1049096516000810
中图分类号
D0 [政治学、政治理论];
学科分类号
0302 ; 030201 ;
摘要
Across the social sciences, growing concerns about research transparency have led to calls for pre-analysis plans (PAPs) that specify in advance how researchers intend to analyze the data they are about to gather. PAPs promote transparency and credibility by helping readers distinguish between exploratory and confirmatory analyses. However, PAPs are time-consuming to write and may fail to anticipate contingencies that arise in the course of data collection. This article proposes the use of "standard operating procedures" (SOPs)-default practices to guide decisions when issues arise that were not anticipated in the PAP. We off er an example of an SOP that can be adapted by other researchers seeking a safety net to support their PAPs.
引用
收藏
页码:495 / 499
页数:5
相关论文
共 29 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects [J].
Anderson, Michael L. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2008, 103 (484) :1481-1495
[3]  
Angrist JD, 1996, J AM STAT ASSOC, V91, P444, DOI 10.2307/2291629
[4]  
[Anonymous], 2015, STANDARD OPERATING P
[5]  
[Anonymous], 2008, CHANCE, DOI DOI 10.1007/S00144-008-0047-X
[6]  
Bidwell K., 2015, The Impact of Voter Knowledge Initiatives in Sierra Leone
[7]   Star Wars: The Empirics Strike Back [J].
Brodeur, Abel ;
Le, Mathias ;
Sangnier, Marc ;
Zylberberg, Yanos .
AMERICAN ECONOMIC JOURNAL-APPLIED ECONOMICS, 2016, 8 (01) :1-32
[8]   Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan [J].
Casey, Katherine ;
Glennerster, Rachel ;
Miguel, Edward .
QUARTERLY JOURNAL OF ECONOMICS, 2012, 127 (04) :1755-1812
[9]   Instead of "playing the game" it is time to change the rules: Registered Reports at AIMS Neuroscience and beyond [J].
Chambers, Christopher D. ;
Feredoes, Eva ;
Muthukumaraswamy, Suresh D. ;
Etchells, Peter J. .
AIMS NEUROSCIENCE, 2014, 1 (01) :4-17
[10]   SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials [J].
Chan, An-Wen ;
Tetzlaff, Jennifer M. ;
Gotzsche, Peter C. ;
Altman, Douglas G. ;
Mann, Howard ;
Berlin, Jesse A. ;
Dickersin, Kay ;
Hrobjartsson, Asbjorn ;
Schulz, Kenneth F. ;
Parulekar, Wendy R. ;
Krleza-Jeric, Karmela ;
Laupacis, Andreas ;
Moher, David .
BMJ-BRITISH MEDICAL JOURNAL, 2013, 346