Modeling Cognitive Load in Mobile Human Computer Interaction Using Eye Tracking Metrics

被引:5
作者
Joseph, Antony William [1 ]
Vaiz, J. Sharmila [2 ]
Murugesh, Ramaswami [2 ]
机构
[1] Natl Inst Design, IT Integrated Design, Bengaluru, Karnataka, India
[2] Madurai Kamaraj Univ, Dept Comp Applicat, Madurai, Tamil Nadu, India
来源
ADVANCES IN ARTIFICIAL INTELLIGENCE, SOFTWARE AND SYSTEMS ENGINEERING (AHFE 2021) | 2021年 / 271卷
关键词
Ocular parameters; Modeling cognitive load; Machine learning; Classification; Eye tracking metrics; Cognitive load levels; Human-computer interaction;
D O I
10.1007/978-3-030-80624-8_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modeling cognitive load of user interaction based on ocular parameters have become a dominant method for exploring usability evaluation of interfaces for systems and applications. Growing importance of Artificial Intelligence in Human Computer Interaction (HCI) has proposed many approaches to understand users' need and enhance human centric method for interface design. In particular, machine learning-based cognitive modeling, using eye tracking parameters have received more attention in the context of smart devices and applications. In this context, this paper aims to model the estimated cognitive load values for each user into different levels of cognition like very high, high, moderate, low, very low etc., while performing different tasks on a smart phone. The study focuses on the use behavioural measures, ocular parameters along with eight traditional machine learning classification algorithms like Decision Tree, Linear Discriminant Analysis, Random Forest, Support Vector Machine, Naive Bayes, Neural Network, Fuzzy Rules withWeight Factor and K-Nearest Neighbor to model different levels of estimated cognitive load for each participant. The data set for modeling consisted of 250 records, 11 ocular parameters as prediction variables including age and type of task; and three types of classes (2-class, 3-class, 5-class) for classifying the estimated cognitive load for each participant. We noted that, Age, Fixation Count, Saccade Count, Saccade Rate, Average Pupil Dilation are the most important parameters contributing to modeling the estimated cognitive load levels. Further, we observed that, the Decision Tree algorithm achieved highest accuracy for classifying estimated cognitive load values into 2-class (86.8%), 3-class (74%) and 5-class (62.8%) respectively. Finally, from our study, it may be noted that, machine learning is an effective method for predicting 2-class-based (Low and High) cognitive load levels using ocular parameters. The outcome of the study also provides the fact that ageing affects users' cognitive workload while performing tasks on smartphone.
引用
收藏
页码:99 / 106
页数:8
相关论文
共 50 条
[41]   Comparing Brain-Computer Interaction and Eye Tracking as Input Modalities: An Exploratory Study [J].
Albilali, Eman ;
Aboalsamh, Hatim ;
Al-Wabil, Areej .
PROCEEDINGS OF THE 2013 INTERNATIONAL CONFERENCE ON CURRENT TRENDS IN INFORMATION TECHNOLOGY (CTIT), 2013, :232-236
[42]   Computer Control and Interaction Using Eye Gaze Direction Detection [J].
Yilmaz, Cagatay Murat ;
Kose, Cemal .
2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, :1658-1661
[43]   Real Time Eye Gaze Tracking for Human Machine Interaction in the Cockpit [J].
Turetkin, Engin ;
Saeedi, Sareh ;
Bigdeli, Siavash ;
Stadelmann, Patrick ;
Cantale, Nicolas ;
Lutnyk, Luis ;
Raubal, Martin ;
Dunbar, L. Andrea .
AI AND OPTICAL DATA SCIENCES III, 2022, 12019
[44]   Pain Level Classification Using Eye-Tracking Metrics and Machine Learning Models [J].
El Othmani, Oussama ;
Naouali, Sami .
COMPUTERS, 2025, 14 (06)
[45]   Cognitive model data analysis for the evaluation of human computer interaction [J].
Dzaack, Jeronimo ;
Urbas, Leon .
ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS, PROCEEDINGS, 2007, 4562 :477-+
[46]   Research on the Integration of Human-Computer Interaction and Cognitive Neuroscience [J].
Miao, Xiu ;
Hou, Wen-jun .
HUMAN WORK INTERACTION DESIGN: ARTIFICIAL INTELLIGENCE AND DESIGNING FOR A POSITIVE WORK EXPERIENCE IN A LOW DESIRE SOCIETY, HWID 2021, 2022, 609 :66-82
[47]   Classification of Driver Cognitive Load: Exploring the Benefits of Fusing Eye-Tracking and Physiological Measures [J].
He, Dengbo ;
Wang, Ziquan ;
Khalil, Elias B. ;
Donmez, Birsen ;
Qiao, Guangkai ;
Kumar, Shekhar .
TRANSPORTATION RESEARCH RECORD, 2022, 2676 (10) :670-681
[48]   A Conceptual Model for Mobile Interaction using Brain Computer Interface [J].
Gaber, Abubaker ;
Ghazali, Masitah ;
Iahad, Noorminshah A. .
INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2018, 11 (02) :71-78
[49]   Human Computer Interaction using Hand Gesture [J].
Sharma, Ram Pratap ;
Verma, Gyanendra K. .
ELEVENTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2015/INDIA ELEVENTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2015/NDIA ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2015, 2015, 54 :721-727
[50]   Structural Modeling Based on Human-Computer Knowledge Interaction [J].
Zhan, Xianglin ;
Li, Shun ;
Tang, Song ;
Zhang, Minzhi ;
Lu, Cai ;
Hu, Guangmin .
APPLIED GEOPHYSICS, 2023,