Modeling Cognitive Load in Mobile Human Computer Interaction Using Eye Tracking Metrics

被引:5
作者
Joseph, Antony William [1 ]
Vaiz, J. Sharmila [2 ]
Murugesh, Ramaswami [2 ]
机构
[1] Natl Inst Design, IT Integrated Design, Bengaluru, Karnataka, India
[2] Madurai Kamaraj Univ, Dept Comp Applicat, Madurai, Tamil Nadu, India
来源
ADVANCES IN ARTIFICIAL INTELLIGENCE, SOFTWARE AND SYSTEMS ENGINEERING (AHFE 2021) | 2021年 / 271卷
关键词
Ocular parameters; Modeling cognitive load; Machine learning; Classification; Eye tracking metrics; Cognitive load levels; Human-computer interaction;
D O I
10.1007/978-3-030-80624-8_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modeling cognitive load of user interaction based on ocular parameters have become a dominant method for exploring usability evaluation of interfaces for systems and applications. Growing importance of Artificial Intelligence in Human Computer Interaction (HCI) has proposed many approaches to understand users' need and enhance human centric method for interface design. In particular, machine learning-based cognitive modeling, using eye tracking parameters have received more attention in the context of smart devices and applications. In this context, this paper aims to model the estimated cognitive load values for each user into different levels of cognition like very high, high, moderate, low, very low etc., while performing different tasks on a smart phone. The study focuses on the use behavioural measures, ocular parameters along with eight traditional machine learning classification algorithms like Decision Tree, Linear Discriminant Analysis, Random Forest, Support Vector Machine, Naive Bayes, Neural Network, Fuzzy Rules withWeight Factor and K-Nearest Neighbor to model different levels of estimated cognitive load for each participant. The data set for modeling consisted of 250 records, 11 ocular parameters as prediction variables including age and type of task; and three types of classes (2-class, 3-class, 5-class) for classifying the estimated cognitive load for each participant. We noted that, Age, Fixation Count, Saccade Count, Saccade Rate, Average Pupil Dilation are the most important parameters contributing to modeling the estimated cognitive load levels. Further, we observed that, the Decision Tree algorithm achieved highest accuracy for classifying estimated cognitive load values into 2-class (86.8%), 3-class (74%) and 5-class (62.8%) respectively. Finally, from our study, it may be noted that, machine learning is an effective method for predicting 2-class-based (Low and High) cognitive load levels using ocular parameters. The outcome of the study also provides the fact that ageing affects users' cognitive workload while performing tasks on smartphone.
引用
收藏
页码:99 / 106
页数:8
相关论文
共 50 条
[31]   Enhancing Student Learning of Human-Computer Interaction Using a Contextual Mobile Application [J].
Alnuaim, Abeer ;
Caleb-Solly, Praminda ;
Perry, Christine .
PROCEEDINGS OF THE 2016 SAI COMPUTING CONFERENCE (SAI), 2016, :952-959
[32]   4th International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction [J].
Pfeiffer, Thies ;
Stellmach, Sophie ;
Sugano, Yusuke .
PROCEEDINGS OF THE 2014 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING (UBICOMP'14 ADJUNCT), 2014, :1085-1091
[33]   The scope of cognitive sciences in human-computer interaction [J].
Romitti, S ;
Santoni, C ;
Francois, P .
FIRST INTERNATIONAL CONFERENCE: MANAGING ENTERPRISES - STAKEHOLDERS, ENGINEERING, LOGISTICS, AND ACHIEVEMENT (ME-SELA'97): CONFERENCE THEME: SUSTAINABLE MANUFACTURING FOR GLOBAL BUSINESS, 1997, :99-104
[34]   Emotion recognition framework using multiple modalities for an effective human-computer interaction [J].
Moin, Anam ;
Aadil, Farhan ;
Ali, Zeeshan ;
Kang, Dongwann .
JOURNAL OF SUPERCOMPUTING, 2023, 79 (08) :9320-9349
[35]   Challenges in Human-Computer Interaction Design for Mobile Devices [J].
Huang, Kuo-Ying .
WCECS 2009: WORLD CONGRESS ON ENGINEERING AND COMPUTER SCIENCE, VOLS I AND II, 2009, :236-241
[36]   The State of Algorithmic Fairness in Mobile Human-Computer Interaction [J].
Yfantidou, Sofia ;
Constantinides, Marios ;
Spathis, Dimitris ;
Vakali, Athena ;
Quercia, Daniele ;
Kawsar, Fahim .
ADJUNCT PROCEEDINGS OF THE 2023 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING & THE 2023 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTING, UBICOMP/ISWC 2023 ADJUNCT, 2023, :777-783
[37]   The State of Algorithmic Fairness in Mobile Human-Computer Interaction [J].
Yfantidou, Sofia ;
Constantinides, Marios ;
Spathis, Dimitris ;
Vakali, Athena ;
Quercia, Daniele ;
Kawsar, Fahim .
PUBLICATION OF THE 25TH ACM INTERNATIONAL CONFERENCE ON MOBILE HUMAN-COMPUTER INTERACTION, MOBILEHCI 2023 ADJUNCT, 2023,
[38]   Modeling Positive Experiences in Human-Computer Interaction [J].
Saari, Timo .
HSI: 2009 2ND CONFERENCE ON HUMAN SYSTEM INTERACTIONS, 2009, :525-532
[39]   An architecture supporting intelligent mobile healthcare using human-computer interaction HCI principles [J].
Alrizq M. ;
Solangi S.A. ;
Alghamdi A. ;
Nizamani M.A. ;
Memon M.A. ;
Hamdi M. .
Computer Systems Science and Engineering, 2021, 40 (02) :557-569
[40]   A Task Modeling Method of Intelligent Human-Computer Interaction in Aircraft Cockpits Based on Information Load Flow [J].
Zhang, Xia ;
Sun, Youchao ;
Zhang, Yanjun .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2022, 58 (06) :5619-5634