Constraints on Generality (COG): A Proposed Addition to All Empirical Papers

被引:710
作者
Simons, Daniel J. [1 ]
Shoda, Yuichi [2 ]
Lindsay, D. Stephen [3 ]
机构
[1] Univ Illinois, Champaign, IL 61820 USA
[2] Univ Washington, Seattle, WA 98195 USA
[3] Univ Victoria, Victoria, BC V8W 2Y2, Canada
关键词
meta-science; transparency; open science; science communication; reproducibility; generalizability; replication; REPLICATION;
D O I
10.1177/1745691617708630
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Psychological scientists draw inferences about populations based on samplesof people, situations, and stimulifrom those populations. Yet, few papers identify their target populations, and even fewer justify how or why the tested samples are representative of broader populations. A cumulative science depends on accurately characterizing the generality of findings, but current publishing standards do not require authors to constrain their inferences, leaving readers to assume the broadest possible generalizations. We propose that the discussion section of all primary research articles specify Constraints on Generality (i.e., a COG statement) that identify and justify target populations for the reported findings. Explicitly defining the target populations will help other researchers to sample from the same populations when conducting a direct replication, and it could encourage follow-up studies that test the boundary conditions of the original finding. Universal adoption of COG statements would change publishing incentives to favor a more cumulative science.
引用
收藏
页码:1123 / 1128
页数:6
相关论文
共 17 条
[1]   The Mozart effect: Tracking the evolution of a scientific legend [J].
Bangerter, A ;
Heath, C .
BRITISH JOURNAL OF SOCIAL PSYCHOLOGY, 2004, 43 :605-623
[2]   The Replication Recipe: What makes for a convincing replication? [J].
Brandt, Mark J. ;
IJzerman, Hans ;
Dijksterhuis, Ap ;
Farach, Frank J. ;
Geller, Jason ;
Giner-Sorolla, Roger ;
Grange, James A. ;
Perugini, Marco ;
Spies, Jeffrey R. ;
van 't Veer, Anna .
JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2014, 50 :217-224
[3]   LANGUAGE AS FIXED-EFFECT FALLACY - CRITIQUE OF LANGUAGE STATISTICS IN PSYCHOLOGICAL RESEARCH [J].
CLARK, HH .
JOURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR, 1973, 12 (04) :335-359
[4]   What Constitutes Strong Psychological Science? The (Neglected) Role of Diagnosticity and A Priori Theorizing [J].
Fiedler, Klaus .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2017, 12 (01) :46-61
[5]   UNDER WHAT CONDITIONS DOES THEORY OBSTRUCT RESEARCH PROGRESS [J].
GREENWALD, AG ;
LEIPPE, MR ;
PRATKANIS, AR ;
BAUMGARDNER, MH .
PSYCHOLOGICAL REVIEW, 1986, 93 (02) :216-229
[6]   Most people are not WEIRD [J].
Henrich, Joseph ;
Heine, Steven J. ;
Norenzayan, Ara .
NATURE, 2010, 466 (7302) :29-29
[7]   Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments [J].
Kruger, J ;
Dunning, D .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1999, 77 (06) :1121-1134
[8]   Generalizability The trees, the forest, and the low-hanging fruit [J].
Kukull, Walter A. ;
Ganguli, Mary .
NEUROLOGY, 2012, 78 (23) :1886-1891
[9]  
Lilienfeld ScottO., 2015, Evidence-Based Communication Assessment and Intervention, P62
[10]  
Lindsay D. S., 2001, Recovered memories: Seeking the middle ground, P71