Fuzzy Cognitive Diagnosis for Modelling Examinee Performance

被引:143
作者
Liu, Qi [1 ]
Wu, Runze [1 ]
Chen, Enhong [1 ]
Xu, Guandong [2 ,3 ]
Su, Yu [4 ,5 ]
Chen, Zhigang [5 ]
Hu, Guoping [5 ]
机构
[1] Univ Sci & Technol China, Anhui Prov Key Lab Big Data Anal & Applicat, Hefei, Anhui, Peoples R China
[2] Univ Technol, Adv Analyt Inst, Sydney, NSW, Australia
[3] Univ Technol, Sch Software, Sydney, NSW, Australia
[4] Anhui Univ, Sch Comp Sci & Technol, Hefei, Anhui, Peoples R China
[5] IFLYTEK Co Ltd, Hefei, Anhui, Peoples R China
基金
澳大利亚研究理事会; 中国国家自然科学基金;
关键词
Cognitive; graphic model; educational data mining; DINA MODEL;
D O I
10.1145/3168361
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent decades have witnessed the rapid growth of educational data mining (EDM), which aims at automatically extracting valuable information from large repositories of data generated by or related to people's learning activities in educational settings. One of the key EDM tasks is cognitive modelling with examination data, and cognitive modelling tries to profile examinees by discovering their latent knowledge state and cognitive level (e.g. the proficiency of specific skills). However, to the best of our knowledge, the problem of extracting information from both objective and subjective examination problems to achieve more precise and interpretable cognitive analysis remains underexplored. To this end, we propose a fuzzy cognitive diagnosis framework (FuzzyCDF) for examinees' cognitive modelling with both objective and subjective problems. Specifically, to handle the partially correct responses on subjective problems, we first fuzzify the skill proficiency of examinees. Then we combine fuzzy set theory and educational hypotheses to model the examinees' mastery on the problems based on their skill proficiency. Finally, we simulate the generation of examination score on each problem by considering slip and guess factors. In this way, the whole diagnosis framework is built. For further comprehensive verification, we apply our FuzzyCDF to three classical cognitive assessment tasks, i.e., predicting examinee performance, slip and guess detection, and cognitive diagnosis visualization. Extensive experiments on three real-world datasets for these assessment tasks prove that FuzzyCDF can reveal the knowledge states and cognitive level of the examinees effectively and interpretatively.
引用
收藏
页数:26
相关论文
共 56 条
[1]  
Anderson A, 2014, WWW'14: PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, P687
[2]  
[Anonymous], 1968, STAT THEORIES MENTAL
[3]  
[Anonymous], 2005, ENCY BIOSTATISTICS
[4]  
[Anonymous], 1961, P 4 BERK S MATH STAT
[5]  
[Anonymous], 2013, ITEM RESPONSE THEORY
[6]  
Baker R. S., 2004, PROC SIGCHI C HUM FA, P383, DOI [DOI 10.1145/985692.985741, 10.1145/985692.985741]
[7]  
Baker RSJD, 2008, LECT NOTES COMPUT SC, V5091, P406
[8]  
Beck JE, 2000, LECT NOTES COMPUT SC, V1839, P584
[9]  
Ben-Naim Dror, 2008, P INT WORKSH INT SUP, P8
[10]   General methods for monitoring convergence of iterative simulations [J].
Brooks, SP ;
Gelman, A .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 1998, 7 (04) :434-455