A test of the diffusion model explanation for the worst performance rule using preregistration and blinding

被引:20
作者
Dutilh, Gilles [1 ]
Vandekerckhove, Joachim [2 ]
Ly, Alexander [3 ]
Matzke, Dora [3 ]
Pedroni, Andreas [1 ]
Frey, Renato [1 ]
Rieskamp, Jorg [1 ]
Wagenmakers, Eric-Jan [3 ]
机构
[1] Univ Basel, Dept Psychol, Missionsstr 60-62, CH-4055 Basel, Switzerland
[2] Univ Calif Irvine, Irvine, CA USA
[3] Univ Amsterdam, Amsterdam, Netherlands
基金
瑞士国家科学基金会;
关键词
Response time model; Preregistration; Predictions; Intelligence; MEMORY; IQ; DISTRIBUTIONS; WORKING; SPEED;
D O I
10.3758/s13414-017-1304-y
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
People with higher IQ scores also tend to perform better on elementary cognitive-perceptual tasks, such as deciding quickly whether an arrow points to the left or the right Jensen (2006). The worst performance rule (WPR) finesses this relation by stating that the association between IQ and elementary-task performance is most pronounced when this performance is summarized by people's slowest responses. Previous research has shown that the WPR can be accounted for in the Ratcliff diffusion model by assuming that the same ability parameter-drift rate-mediates performance in both elementary tasks and higher-level cognitive tasks. Here we aim to test four qualitative predictions concerning the WPR and its diffusion model explanation in terms of drift rate. In the first stage, the diffusion model was fit to data from 916 participants completing a perceptual two-choice task; crucially, the fitting happened after randomly shuffling the key variable, i.e., each participant's score on a working memory capacity test. In the second stage, after all modeling decisions were made, the key variable was unshuffled and the adequacy of the predictions was evaluated by means of confirmatory Bayesian hypothesis tests. By temporarily withholding the mapping of the key predictor, we retain flexibility for proper modeling of the data (e.g., outlier exclusion) while preventing biases from unduly influencing the results. Our results provide evidence against the WPR and suggest that it may be less robust and less ubiquitous than is commonly believed.
引用
收藏
页码:713 / 725
页数:13
相关论文
共 36 条
[21]   Hide results to seek the truth [J].
MacCoun, Robert ;
Perlmutter, Saul .
NATURE, 2015, 526 (7572) :187-189
[22]   Modeling response times for two-choice decisions [J].
Ratcliff, R ;
Rouder, JN .
PSYCHOLOGICAL SCIENCE, 1998, 9 (05) :347-356
[23]   THEORY OF MEMORY RETRIEVAL [J].
RATCLIFF, R .
PSYCHOLOGICAL REVIEW, 1978, 85 (02) :59-108
[24]   A diffusion model explanation of the worst performance rule for reaction tune and IQ [J].
Ratcliff, Roger ;
Schmiedek, Florian ;
McKoon, Gail .
INTELLIGENCE, 2008, 36 (01) :10-17
[25]   Effects of Aging and IQ on Item and Associative Memory [J].
Ratcliff, Roger ;
Thapar, Anjali ;
McKoon, Gail .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2011, 140 (03) :464-487
[26]   Individual differences, aging, and IQ in two-choice tasks [J].
Ratcliff, Roger ;
Thapar, Anjali ;
McKoon, Gail .
COGNITIVE PSYCHOLOGY, 2010, 60 (03) :127-157
[27]   Individual differences in components their relations to working of reaction time distributions and memory and intelligence [J].
Schmiedek, Florian ;
Oberauer, Klaus ;
Wilhelm, Oliver ;
Suess, Heinz-Martin ;
Wittmann, Wemer W. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2007, 136 (03) :414-429
[28]  
Schmitz F., 2016, J. Intell, V4, P13, DOI [10.3390/jintelligence4040013, DOI 10.3390/JINTELLIGENCE4040013]
[29]   Lapses in sustained attention and their relation to executive control and fluid abilities: An individual differences investigation [J].
Unsworth, Nash ;
Redick, Thomas S. ;
Lakey, Chad E. ;
Young, Diana L. .
INTELLIGENCE, 2010, 38 (01) :111-122
[30]   An integrated perspective on the relation between response speed and intelligence [J].
van Ravenzwaaij, Don ;
Brown, Scott ;
Wagenmakers, Eric-Jan .
COGNITION, 2011, 119 (03) :381-393