Automatic classification of eye activity for cognitive load measurement with emotion interference

被引:90
作者
Chen, Siyuan [1 ,2 ]
Epps, Julien [1 ,2 ]
机构
[1] Univ New S Wales, Sch Elect Engn & Telecommun, Kensington, NSW 2052, Australia
[2] Natl ICT Australia NICTA, Eveleigh, NSW 2015, Australia
关键词
Cognitive load; Physiological measures; Eye activity; Pupil; Blink; Fixation; Saccade; Eye movement; PUPILLARY RESPONSES; WORKLOAD; RECOVERY; DURATION; MEMORY; IMPACT;
D O I
10.1016/j.cmpb.2012.10.021
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Measuring cognitive load changes can contribute to better treatment of patients, can help design effective strategies to reduce medical errors among clinicians and can facilitate user evaluation of health care information systems. This paper proposes an eye-based automatic cognitive load measurement (CLM) system toward realizing these prospects. Three types of eye activity are investigated: pupillary response, blink and eye movement (fixation and saccade). Eye activity features are investigated in the presence of emotion interference, which is a source of undesirable variability, to determine the susceptibility of CLM systems to other factors. Results from an experiment combining arithmetic-based tasks and affective image stimuli demonstrate that arousal effects are dominated by cognitive load during task execution. To minimize the arousal effect on CLM, the choice of segments for eye-based features is examined. We then propose a feature set and classify three levels of cognitive load. The performance of cognitive load level prediction was found to be close to that of a reaction time measure, showing the feasibility of eye activity features for near-real time CLM. (c) 2012 Elsevier Ireland Ltd. All rights reserved.
引用
收藏
页码:111 / 124
页数:14
相关论文
共 44 条
[1]   Human-computer interaction in the administration and analysis of neuropsychological tests [J].
Aharonson, V ;
Korczyn, AD .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2004, 73 (01) :43-53
[2]   PUPILLARY RESPONSES DURING INFORMATION-PROCESSING VARY WITH SCHOLASTIC APTITUDE-TEST SCORES [J].
AHERN, S ;
BEATTY, J .
SCIENCE, 1979, 205 (4412) :1289-1292
[3]  
[Anonymous], 2005, Technical Report A-6
[4]  
[Anonymous], 1990, Physiological Metrics of Mental Workload: A Review of Recent Progress, DOI [DOI 10.1201/9781003069447-14/PHYSIOLOGICAL-METRICS-MENTAL-WORKLOAD-REVIEW-RECENT-PROGRESS-ARTHUR-KRAMER, DOI 10.21236/ADA223701]
[5]   TASK-EVOKED PUPILLARY RESPONSES, PROCESSING LOAD, AND THE STRUCTURE OF PROCESSING RESOURCES [J].
BEATTY, J .
PSYCHOLOGICAL BULLETIN, 1982, 91 (02) :276-292
[6]   Cognitive evaluation: How to assess the usability of information technology in healthcare [J].
BeuscartZephir, MC ;
Brender, J ;
Beuscart, R ;
MenagerDepriester, I .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 1997, 54 (1-2) :19-28
[7]   The pupil as a measure of emotional arousal and autonomic activation [J].
Bradley, Margaret M. ;
Miccoli, Laura ;
Escrig, Miguel A. ;
Lang, Peter J. .
PSYCHOPHYSIOLOGY, 2008, 45 (04) :602-607
[8]  
BRANDT J, 1983, ARCH GEN PSYCHIAT, V40, P435
[9]   Psychophysiology and adaptive automation [J].
Byrne, EA ;
Parasuraman, R .
BIOLOGICAL PSYCHOLOGY, 1996, 42 (03) :249-268
[10]   Rapid visual information processing in schizophrenic patients: The impact of cognitive load and duration of stimulus presentation - A pilot study [J].
Cattapan-Ludewig, K ;
Hilti, CC ;
Ludewig, S ;
Vollenweider, FX ;
Feldon, J .
NEUROPSYCHOBIOLOGY, 2005, 52 (03) :130-134