Promoting Replicability in Developmental Research Through Meta-analyses: Insights From Language Acquisition Research

被引:109
作者
Bergmann, Christina [1 ,2 ]
Tsuji, Sho [1 ,3 ]
Piccinini, Page E. [1 ]
Lewis, Molly L. [4 ,5 ]
Braginsky, Mika [6 ]
Frank, Michael C. [7 ]
Cristia, Alejandrina [1 ]
机构
[1] PSL Res Univ, Paris, France
[2] Max Planck Inst Psycholinguist, Nijmegen, Netherlands
[3] Univ Penn, Philadelphia, PA 19104 USA
[4] Univ Chicago, Chicago, IL 60637 USA
[5] Univ Wisconsin Madison, Madison, WI USA
[6] MIT, Cambridge, MA 02139 USA
[7] Stanford Univ, Stanford, CA 94305 USA
基金
欧盟地平线“2020”;
关键词
STATISTICAL POWER; PUBLICATION; SIZE; SPEECH; TIME;
D O I
10.1111/cdev.13079
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
Previous work suggests that key factors for replicability, a necessary feature for theory building, include statistical power and appropriate research planning. These factors are examined by analyzing a collection of 12 standardized meta-analyses on language development between birth and 5 years. With a median effect size of Cohen's d = .45 and typical sample size of 18 participants, most research is underpowered (range = 6%-99%; median = 44%); and calculating power based on seminal publications is not a suitable strategy. Method choice can be improved, as shown in analyses on exclusion rates and effect size as a function of method. The article ends with a discussion on how to increase replicability in both language acquisition studies specifically and developmental research more generally.
引用
收藏
页码:1996 / 2009
页数:14
相关论文
共 43 条
[1]  
American Psychological Association, 2001, PUBL MAN AM PSYCH AS
[2]  
[Anonymous], 2016, P 38 ANN C COGN SCI
[3]   OPERATING CHARACTERISTICS OF A BANK CORRELATION TEST FOR PUBLICATION BIAS [J].
BEGG, CB ;
MAZUMDAR, M .
BIOMETRICS, 1994, 50 (04) :1088-1101
[4]   Top-down versus bottom-up theories of phonological acquisition: A big data approach [J].
Bergmann, Christina ;
Tsuji, Sho ;
Cristia, Alejandrina .
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, :2103-2107
[5]   Development of infants' segmentation of words from native speech: a meta-analytic approach [J].
Bergmann, Christina ;
Cristia, Alejandrina .
DEVELOPMENTAL SCIENCE, 2016, 19 (06) :901-917
[6]  
Black A., 2017, 39th Annual Meeting of the Cognitive Science Society, P124
[7]   Power failure: why small sample size undermines the reliability of neuroscience [J].
Button, Katherine S. ;
Ioannidis, John P. A. ;
Mokrysz, Claire ;
Nosek, Brian A. ;
Flint, Jonathan ;
Robinson, Emma S. J. ;
Munafo, Marcus R. .
NATURE REVIEWS NEUROSCIENCE, 2013, 14 (05) :365-376
[8]  
Champely S., 2015, pwr: Basic Functions for Power Analysis
[9]  
Cohen J., 1988, STAT POWER ANAL BEHA, DOI [10.4324/9780203771587, DOI 10.4324/9780203771587]
[10]   The relation between pointing and language development: A meta-analysis [J].
Colonnesi, Cristina ;
Stams, Geert Jan J. M. ;
Koster, Irene ;
Noom, Marc J. .
DEVELOPMENTAL REVIEW, 2010, 30 (04) :352-366