EEG-based Evaluation of Cognitive Workload Induced by Acoustic Parameters for Data Sonification

被引:13
作者
Bilalpur, Maneesh [1 ]
Kankanhalli, Mohan [2 ]
Winkler, Stefan [3 ]
Subramanian, Ramanathan [3 ]
机构
[1] IIIT Hyderabad, CVIT, Hyderabad, India
[2] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[3] Univ Illinois, Adv Digital Sci Ctr, Singapore, Singapore
来源
ICMI'18: PROCEEDINGS OF THE 20TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION | 2018年
基金
新加坡国家研究基金会;
关键词
Data Sonification; EEG; Cognitive Workload; Acoustic parameters; VISUALIZATION;
D O I
10.1145/3242969.3243016
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Data Visualization has been receiving growing attention recently, with ubiquitous smart devices designed to render information in a variety of ways. However, while evaluations of visual tools for their interpretability and intuitiveness have been commonplace, not much research has been devoted to other forms of data rendering, e.g., sonification. This work is the first to automatically estimate the cognitive load induced by different acoustic parameters considered for sonification in prior studies [9, 10]. We examine cognitive load via (a) perceptual data-sound mapping accuracies of users for the different acoustic parameters, (b) cognitive workload impressions explicitly reported by users, and (c) their implicit EEG responses compiled during the mapping task. Our main findings are that (i) low cognitive load-inducing (i.e., more intuitive) acoustic parameters correspond to higher mapping accuracies, (ii) EEG spectral power analysis reveals higher a band power for low cognitive load parameters, implying a congruent relationship between explicit and implicit user responses, and (iii) Cognitive load classification with EEG features achieves a peak F1-score of 0.64, confirming that reliable workload estimation is achievable with user EEG data compiled using wearable sensors.
引用
收藏
页码:315 / 323
页数:9
相关论文
共 27 条
[1]   A User Study of Visualization Effectiveness Using EEG and Cognitive Load [J].
Anderson, E. W. ;
Potter, K. C. ;
Matzen, L. E. ;
Shepherd, J. F. ;
Preston, G. A. ;
Silva, C. T. .
COMPUTER GRAPHICS FORUM, 2011, 30 (03) :791-800
[2]  
[Anonymous], 2018, Computer Vision, Pattern Recognition, Image Processing, and Graphics
[3]  
Bashivan P, 2015, ARXIV151106448
[4]  
Bellack Alan S, 1998, INTRO COMPREHENSIVE
[5]  
Bilalpur M., 2017, ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction, P379, DOI [DOI 10.1145/3136755.3136790, 10.1145/3136755, DOI 10.1145/3136755]
[6]   Protovis: A Graphical Toolkit for Visualization [J].
Bostock, Michael ;
Heer, Jeffrey .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2009, 15 (06) :1121-1128
[7]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[8]   On the Proper Treatment of the N400 and P600 in Language Comprehension [J].
Brouwer, Harm ;
Crocker, Matthew W. .
FRONTIERS IN PSYCHOLOGY, 2017, 8
[9]  
Chen F, 2016, HUM-COMPUT INT-SPRIN, P1, DOI 10.1007/978-3-319-31700-7
[10]   Error Related Negativity in Observing Interactive Tasks [J].
Chi Thanh Vi ;
Jamil, Izdihar ;
Coyle, David ;
Subramanian, Sriram .
32ND ANNUAL ACM CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2014), 2014, :3787-3796