An algorithm for online detection of temporal changes in operator cognitive state using real-time psychophysiological data

被引:17
作者
Cannon, Jordan A.
Krokhmal, Pavlo A. [1 ]
Lenth, Russell V. [2 ]
Murphey, Robert [3 ]
机构
[1] Univ Iowa, Dept Mech & Ind Engn, Seamans Ctr 3131, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Stat & Actuarial Sci, Iowa City, IA 52242 USA
[3] USAF, Res Lab, Munit Directorate, Eglin AFB, FL 32542 USA
基金
美国国家科学基金会;
关键词
Cognitive state; Psychophysiological data; EEG; EOG; Kullback-Leibler distance; Statistical analysis; SERIES PREDICTION; EEG; TASK; SYSTEM; INDEXES;
D O I
10.1016/j.bspc.2010.03.005
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
We consider the problem of on-the-fly detection of temporal changes in the cognitive state of human subjects due to varying levels of difficulty of performed tasks using real-time EEG and EOG data. We construct the Cognitive State Indicator (CSI) as a function that projects the multidimensional EEG/EOG signals onto the interval [0,1] by maximizing the Kullback-Leibler distance between distributions of the signals, and whose values change continuously with variations in cognitive load. During offline testing (i.e., when evolution in time is disregarded) it was demonstrated that the CSI can serve as a statistically significant discriminator between states of different cognitive loads. In the online setting, a trend detection heuristic (TDH) has been proposed to detect real-time changes in the cognitive state by monitoring trends in the CSI. Our results support the application of the CSI and the TDH in future closed-loop control systems with human supervision. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:229 / 236
页数:8
相关论文
共 24 条
[1]  
[Anonymous], P HUM FACT ERG SOC 4
[2]   Psychophysiology and adaptive automation [J].
Byrne, EA ;
Parasuraman, R .
BIOLOGICAL PSYCHOLOGY, 1996, 42 (03) :249-268
[3]   A time-series prediction approach for feature extraction in a brain-computer interface [J].
Coyle, D ;
Prasad, G ;
McGinnity, TM .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2005, 13 (04) :461-467
[5]   Evaluation of an adaptive automation system using three EEG indices with a visual tracking task [J].
Freeman, FG ;
Mikulka, PJ ;
Prinzel, LJ ;
Scerbo, MW .
BIOLOGICAL PSYCHOLOGY, 1999, 50 (01) :61-76
[6]   High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice [J].
Gevins, A ;
Smith, ME ;
McEvoy, L ;
Yu, D .
CEREBRAL CORTEX, 1997, 7 (04) :374-385
[7]   Monitoring working memory load during computer-based tasks with EEG pattern recognition methods [J].
Gevins, A ;
Smith, ME ;
Leong, H ;
McEvoy, L ;
Whitfield, S ;
Du, R ;
Rush, G .
HUMAN FACTORS, 1998, 40 (01) :79-91
[8]   Propagation of EEG activity in the beta and gamma band during movement imagery in humans [J].
Ginter, J ;
Blinowska, KJ ;
Kaminski, M ;
Durka, PJ ;
Pfurtscheller, G ;
Neuper, C .
METHODS OF INFORMATION IN MEDICINE, 2005, 44 (01) :106-113
[9]   Removal of ocular artifacts from the EEG: a comparison between time-domain regression method and adaptive filtering method using simulated data [J].
He, Ping ;
Wilson, Glenn ;
Russell, Christopher ;
Gerschutz, Maria .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2007, 45 (05) :495-503
[10]   POTENTIAL FLOW OF FRONTAL MIDLINE THETA-ACTIVITY DURING A MENTAL TASK IN THE HUMAN ELECTROENCEPHALOGRAM [J].
INOUYE, T ;
SHINOSAKI, K ;
IYAMA, A ;
MATSUMOTO, Y ;
TOI, S ;
ISHIHARA, T .
NEUROSCIENCE LETTERS, 1994, 169 (1-2) :145-148