Cognitive process validation of an online problem solving assessment

被引：17
作者：
Chung, GKWK
de Vries, LF
Cheak, AM
Stevens, RH
Bewley, WL
机构：
[1] Univ Calif Los Angeles, CRESST, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Sch Med, Grad Sch Educ & Informat Studies, Culver City, CA 90230 USA
来源：
COMPUTERS IN HUMAN BEHAVIOR | 2002年 / 18卷 / 06期
关键词：
problem solving; computer-based assessment; cognitive processes; IMMEX;
D O I：
10.1016/S0747-5632(02)00023-7
中图分类号：
B84 [心理学];
学科分类号：
04 ; 0402 ;
摘要：
In this study we tested a novel cognitive validation strategy that yoked participants' verbal protocols with their clickstream data using a problem solving assessment (IMMEX-Interactive Multimedia Exercises). Participants were presented with a scenario and provided with relevant and irrelevant information to solve the task. Participants could access the information in any order and attempt to solve the problem at any time. The most frequently occurring cognitive processes were paraphrasing text, accurate cause-effect inferences, and monitoring of problem solving behavior. Productive processes were related to success and consistent with scientific reasoning behavior on the task and unproductive processes were related to unsuccessful performance and consistent with poor reasoning. We found strong evidence of the cognitive validity of the IMMEX task. Components of an online process-based assessment testbed are identified. (C) 2002 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码：669 / 684
页数：16
相关论文
共 25 条
[1]  
[Anonymous], 2001, EDUC MEAS-ISSUES PRA
[2]  
[Anonymous], 1999, STAND ED PSYCH TEST
[3]  
BAKER E, 1992, CRESST PERFORMANCE A
[4]   Computer-based assessment of problem solving [J].
Baker, EL ;
Mayer, RE .
COMPUTERS IN HUMAN BEHAVIOR, 1999, 15 (3-4) :269-282
[5]   Model-based performance assessment [J].
Baker, EL .
THEORY INTO PRACTICE, 1997, 36 (04) :247-254
[6]  
Bennett R. E., 1998, ED MEASUREMENT ISSUE, V17, P9, DOI [https://doi.org/10.1111/j.1745-3992.1998.tb00631.x, DOI 10.1111/J.1745-3992.1998.TB00631.X]
[7]  
Bennett R. E., 1999, Educational measurement: Issues and practice, V18, P5, DOI [DOI 10.1111/J.1745-3992.1999.TB00266.X, 10.1111/j.1745-3992.1999.tb00266.x]
[8]   Graphical modeling: A new response type for measuring the qualitative component of mathematical reasoning [J].
Bennett, RE ;
Morley, M ;
Quardt, D ;
Rock, DA .
APPLIED MEASUREMENT IN EDUCATION, 2000, 13 (03) :303-322
[9]  
BURSTEIN JC, 2001, ANN M NAT COUNC MEAS
[10]  
CHUNG GKW, IN PRESS AUTOMATED E
123