Priority attribute algorithm for Q-matrix validation: A didactic

被引:0
作者
Qin, Haijiang [1 ]
Guo, Lei [1 ,2 ]
机构
[1] Southwest Univ, Fac Psychol, Chongqing, Peoples R China
[2] Southwest Univ Branch, Collaborat Innovat Ctr Assessment Basic Educ Qual, Chongqing, Peoples R China
关键词
Cognitive diagnosis; G-DINA; Q-matrix validation; Priority attribute algorithm; Iterative procedure; DINA MODEL; CLASSIFICATION ACCURACY; COGNITIVE DIAGNOSIS; GENERAL-METHOD; MISSPECIFICATION; IDENTIFIABILITY; NUMBER; FIT;
D O I
10.3758/s13428-024-02547-5
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
The Q-matrix is one of the core components of cognitive diagnostic assessment, which is a matrix describing the relationship between items and the attributes being assessed. Numerous studies have shown that inaccuracies in defining the Q-matrix can degrade parameter estimation and model fitting results. Currently, Q-matrix validation often involves exhaustive search algorithms (ESA), which traverse through all possible q\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$q$$\end{document}-vectors and determine the optimal q\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$q$$\end{document}-vector for items based on indicators or criteria corresponding to different validation methods. However, ESA methods are time-consuming, especially when the number of attributes is large, as the search complexity grows exponentially. This study proposes a more efficient search algorithm, the priority attribute algorithm (PAA), which conducts searches one by one according to the priority of attributes, greatly simplifying the search process. Simulation studies indicate that PAA can significantly enhance search efficiency while maintaining the same or even higher accuracy than ESA, particularly when dealing with a large number of attributes. Moreover, the Q-matrix validation method employing PAA demonstrates better applicability to small samples. A real-data analysis indicates that applying the PAA-based Q-matrix validation method may yield suggested Q-matrices with higher model-data fit and greater practical utility.
引用
收藏
页数:33
相关论文
共 55 条
[1]  
Akaike H., 1992, Selected papers of Hirotugu Akaike, P610, DOI [10.1007/978-1-4612-0919-5_38, DOI 10.1007/978-1-4612-1694-0_15, DOI 10.1007/978-1-4612-1694-015]
[2]   Comparison of Akaike information criterion and consistent Akaike information criterion for model selection and statistical inference from capture-recapture studies [J].
Anderson, DR ;
Burnham, KP ;
White, GC .
JOURNAL OF APPLIED STATISTICS, 1998, 25 (02) :263-282
[3]  
Chen J., 2014, Psychology, V5, P1967, DOI [10.4236/psych.2014.518200, DOI 10.4236/PSYCH.2014.518200]
[4]   A Residual-Based Approach to Validate Q-Matrix Specifications [J].
Chen, Jinsong .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2017, 41 (04) :277-293
[5]   Bayesian Estimation of the DINA Q matrix [J].
Chen, Yinghan ;
Culpepper, Steven Andrew ;
Chen, Yuguo ;
Douglas, Jeffrey .
PSYCHOMETRIKA, 2018, 83 (01) :89-108
[6]   Cognitive Diagnosis for Small Educational Programs: The General Nonparametric Classification Method [J].
Chiu, Chia-Yi ;
Sun, Yan ;
Bian, Yanhong .
PSYCHOMETRIKA, 2018, 83 (02) :355-375
[7]   Statistical Refinement of the Q-Matrix in Cognitive Diagnosis [J].
Chiu, Chia-Yi .
APPLIED PSYCHOLOGICAL MEASUREMENT, 2013, 37 (08) :598-618
[8]   A Nonparametric Approach to Cognitive Diagnosis by Proximity to Ideal Response Patterns [J].
Chiu, Chia-Yi ;
Douglas, Jeff .
JOURNAL OF CLASSIFICATION, 2013, 30 (02) :225-250
[9]   Cluster Analysis for Cognitive Diagnosis: Theory and Applications [J].
Chiu, Chia-Yi ;
Douglas, Jeffrey A. ;
Li, Xiaodong .
PSYCHOMETRIKA, 2009, 74 (04) :633-665
[10]   A Gibbs sampling algorithm that estimates the Q-matrix for the DINA model [J].
Chung, Mengta .
JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2019, 93