60th Anniversary Essay: How Journals Could Improve Research Practices in Social Science

被引:79
作者
Starbuck, William H. [1 ]
机构
[1] Univ Oregon, Lundquist Coll Business, Eugene, OR 97403 USA
关键词
editors; editorial policies; reviewing; statistical analyses; hypotheses; empirical findings; DOUBLE-BLIND; RELIABILITY; CONSTRUCTION; FAVORITISM; PSYCHOLOGY; COMPUSTAT; SEARCH;
D O I
10.1177/0001839216629644
中图分类号
F [经济];
学科分类号
02 ;
摘要
This essay proposes ways to improve editorial evaluations of manuscripts and to make published research more reliable and trustworthy. It points to troublesome properties of current editorial practices and suggests that editorial evaluations could become more reliable by making more allowance for reviewers' human limitations. The essay also identifies some troublesome properties of prevalent methodology, such as statistical significance tests, HARKing, and p-Hacking, and proposes editorial policies to mitigate these detrimental behaviors.
引用
收藏
页码:165 / 183
页数:19
相关论文
共 70 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]  
Acharya A., 2014, ARXIV14102217 GOOGL
[3]  
[Anonymous], 1982, Judgment Under Uncertainty: Heuristics and Biases, DOI DOI 10.1017/CBO9780511809477.023
[4]   UNINTELLIGIBLE MANAGEMENT RESEARCH AND ACADEMIC PRESTIGE [J].
ARMSTRONG, JS .
INTERFACES, 1980, 10 (02) :80-86
[5]   RELIABILITY, FAIRNESS, OBJECTIVITY, AND OTHER INAPPROPRIATE GOALS IN PEER-REVIEW [J].
BAILAR, JC .
BEHAVIORAL AND BRAIN SCIENCES, 1991, 14 (01) :137-137
[6]  
BEDEIAN AG, 2008, OPENING BLACK BOX ED, P134
[7]   Peer Review and the Social Construction of Knowledge in the Management Discipline [J].
Bedeian, Arthur G. .
ACADEMY OF MANAGEMENT LEARNING & EDUCATION, 2004, 3 (02) :198-216
[8]   Management Science on the Credibility Bubble: Cardinal Sins and Various Misdemeanors [J].
Bedeian, Arthur G. ;
Taylor, Shannon G. ;
Miller, Alan N. .
ACADEMY OF MANAGEMENT LEARNING & EDUCATION, 2010, 9 (04) :715-725
[9]   Decimal Dust, Significant Digits, and the Search for Stars [J].
Bedeian, Arthur G. ;
Sturman, Michael C. ;
Streiner, David L. .
ORGANIZATIONAL RESEARCH METHODS, 2009, 12 (04) :687-694
[10]   CREATING REPEATABLE CUMULATIVE KNOWLEDGE IN STRATEGIC MANAGEMENT: A CALL FOR A BROAD AND DEEP CONVERSATION AMONG AUTHORS, REFEREES, AND EDITORS [J].
Bettis, Richard A. ;
Ethiraj, Sendil ;
Gambardella, Alfonso ;
Helfat, Constance ;
Mitchell, Will .
STRATEGIC MANAGEMENT JOURNAL, 2016, 37 (02) :257-261