Developmental psychologists should adopt citizen science to improve generalization and reproducibility

被引:10
作者
Li, Wei [1 ]
Germine, Laura Thi [2 ,3 ]
Mehr, Samuel A. [4 ,5 ]
Srinivasan, Mahesh [6 ]
Hartshorne, Joshua [1 ]
机构
[1] Boston Coll, Dept Psychol & Neurosci, 140 Commonwealth Ave, Chestnut Hill, MA 02467 USA
[2] McLean Hosp, 115 Mill St, Belmont, MA 02178 USA
[3] Harvard Med Sch, Dept Psychiat, Cambridge, MA USA
[4] Harvard Univ, Data Sci Initiat, Cambridge, MA 02138 USA
[5] Victoria Univ Wellington, Sch Psychol, Wellington, New Zealand
[6] Univ Calif Berkeley, Dept Psychol, 3210 Tolman Hall, Berkeley, CA 94720 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
citizen science; generalizability; online experiments; replicability; STATISTICAL POWER; MECHANICAL TURK; SOCIAL-PSYCHOLOGY; CRITICAL PERIOD; EFFECT SIZES; SAMPLE-SIZE; LIFE-SPAN; PERSONALITY; LANGUAGE; FAILURE;
D O I
10.1002/icd.2348
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Widespread failures of replication and generalization are, ironically, a scientific triumph, in that they confirm the fundamental metascientific theory that underlies our field. Generalizable and replicable findings require testing large numbers of subjects from a wide range of demographics with a large, randomly-sampled stimulus set, and using a variety of experimental parameters. Because few studies accomplish any of this, meta-scientists predict that findings will frequently fail to replicate or generalize. We argue that to be more robust and replicable, developmental psychology needs to find a mechanism for collecting data at a greater scale and from more diverse populations. Luckily, this mechanism already exists as follows: Citizen science, in which large numbers of uncompensated volunteers provide data. While best-known for its contributions to astronomy and ecology, citizen science has also produced major findings in neuroscience and psychology, and increasingly in developmental psychology. We provide examples, address practical challenges, discuss limitations, and compare to other methods of obtaining large datasets. Ultimately, we argue that the range of studies where it makes sense *not* to use citizen science is steadily dwindling.
引用
收藏
页数:23
相关论文
共 209 条
[31]   THEORY OF FLUID AND CRYSTALLIZED INTELLIGENCE - A CRITICAL EXPERIMENT [J].
CATTELL, RB .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1963, 54 (01) :1-22
[32]   What's next for Registered Reports? [J].
Chambers, Chris .
NATURE, 2019, 573 (7773) :187-189
[33]   Lie for a Dime: When Most Prescreening Responses Are Honest but Most Study Participants Are Impostors [J].
Chandler, Jesse J. ;
Paolacci, Gabriele .
SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE, 2017, 8 (05) :500-508
[34]  
Chari R., 2017, The promise of community citizen science
[35]   STATISTICAL POWER ANALYSIS OF APPLIED PSYCHOLOGICAL-RESEARCH [J].
CHASE, LJ ;
CHASE, RB .
JOURNAL OF APPLIED PSYCHOLOGY, 1976, 61 (02) :234-237
[36]   More evidence from over 1.1 million subjects that the critical period for syntax closes in late adolescence [J].
Chen, Tony ;
Hartshorne, Joshua K. .
COGNITION, 2021, 214
[37]   What’s next for psychology’s embattled field of social priming [J].
Tom Chivers .
Nature, 2019, 576 (7786) :200-202
[38]   An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results [J].
Chmielewski, Michael ;
Kucker, Sarah C. .
SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE, 2020, 11 (04) :464-473
[39]   LANGUAGE AS FIXED-EFFECT FALLACY - CRITIQUE OF LANGUAGE STATISTICS IN PSYCHOLOGICAL RESEARCH [J].
CLARK, HH .
JOURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR, 1973, 12 (04) :335-359
[40]   The account taken of statistical power in research published in the British Journal of Psychology [J].
ClarkCarter, D .
BRITISH JOURNAL OF PSYCHOLOGY, 1997, 88 :71-83