How useful are specific cognitive ability scores? An investigation of their stability and incremental validity beyond general intelligence

被引:4
作者
Breit, Moritz [1 ,2 ]
Scherrer, Vsevolod [1 ]
Preckel, Franzis [1 ]
机构
[1] Univ Trier, Dept Psychol, Trier, Germany
[2] Univ Trier, Dept Psychol, Giftedness Res & Educ, Univ Ring 15, D-54296 Trier, Germany
关键词
Test -retest stability; Reliability; Intelligence profiles; Cognitive ability; Incremental validity; LONG-TERM STABILITY; WORKING-MEMORY CAPACITY; FACTOR INDEX SCORES; WISC-IV; CRYSTALLIZED INTELLIGENCE; WECHSLER INTELLIGENCE; III SUBTEST; REASONING ABILITY; PROFILE ANALYSIS; BERLIN MODEL;
D O I
10.1016/j.intell.2024.101816
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Many intelligence tests measure multiple specific cognitive abilities. Practitioners use these specific ability scores, which encompass both specific ability and general intelligence variance, and the resulting intelligence profiles to make counseling and intervention decisions. In the present study, we investigated the temporal stability of eight specific abilities and their profiles over one school year, as well as their incremental validity in the prediction of school grades with German grade 7 to 9 students (N = 326 at T1; N = 311 at T2; N = 257 with IQ data at both times of measurement). The mean rank -order stability was 0.80 and ranged from 0.71 to 0.85. Intelligence profiles replicated significantly above chance levels (Mdn kappa = 0.31). The incremental validity coefficients were mostly small, but the Reasoning score substantially contributed to the prediction of math grades (Delta R2 = 0.07-0.09), the Verbal Ability score to the prediction of German grades (Delta R2 = 0.05-0.09), and the Crystallized Intelligence score to the prediction of geography grades (Delta R2 = 0.03-0.08) beyond the general intelligence score. Our study of specific ability scores indicated moderate to high rank -order stability, fair to moderate profile stability, and substantial incremental validity for some specific ability scores.
引用
收藏
页数:15
相关论文
共 108 条
[1]   Effort in Low-Stakes Assessments: What Does It Take to Perform as Well as in a High-Stakes Setting? [J].
Attali, Yigal .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2016, 76 (06) :1045-1058
[2]   Attention Problems and Stability of WISC-IV Scores Among Clinically Referred Children [J].
Bartoi, Marla Green ;
Issner, Jaclyn Beth ;
Hetterscheidt, Lesley ;
January, Alicia M. ;
Kuentzel, Jeffrey Garth ;
Barnett, Douglas .
APPLIED NEUROPSYCHOLOGY-CHILD, 2015, 4 (03) :133-140
[3]  
Bates D., 2022, Linear Mixed-Effects Models using Eigen and S4, DOI DOI 10.5281/ZENODO.7056440
[4]  
BAYLEY N, 1949, J GENET PSYCHOL, V75, P165
[5]   Fluid and crystallized intelligence and the Berlin Model of Intelligence Structure (BIS) [J].
Beauducel, A ;
Kersting, M .
EUROPEAN JOURNAL OF PSYCHOLOGICAL ASSESSMENT, 2002, 18 (02) :97-112
[6]   Perspectives on fluid and crystallized intelligence: facets for verbal, numerical, and figural intelligence [J].
Beauducel, A ;
Brocke, B ;
Liepmann, D .
PERSONALITY AND INDIVIDUAL DIFFERENCES, 2001, 30 (06) :977-994
[7]   Examining the integrity of measurement of cognitive abilities in the prediction of achievement: Comparisons and contrasts across variables from higher-order and bifactor models [J].
Benson, Nicholas F. ;
Kranzler, John H. ;
Floyd, Randy G. .
JOURNAL OF SCHOOL PSYCHOLOGY, 2016, 58 :1-19
[8]   Realizing the Promise of Research in Policymaking: Theoretical Guidance Grounded in Policymaker Perspectives [J].
Bogenschneider, Karen ;
Corbett, Thomas J. ;
Parrott, Emily .
JOURNAL OF FAMILY THEORY & REVIEW, 2019, 11 (01) :127-147
[9]   Long-term stability of membership in a Wechsler Intelligence Scale for Children-Third Edition (WISC-III) subtest core profile taxonomy [J].
Borsuk, Ellen R. ;
Watkins, Marley W. ;
Canivez, Gary L. .
JOURNAL OF PSYCHOEDUCATIONAL ASSESSMENT, 2006, 24 (01) :52-68
[10]   What's in a grade? The multidimensional nature of what teacher-assigned grades assess in high school [J].
Bowers, Alex J. .
EDUCATIONAL RESEARCH AND EVALUATION, 2011, 17 (03) :141-159