Measuring Cognitive Load Through Event Camera Based Human-Pose Estimation

被引:1
作者
Aitsam, Muhammad [1 ]
Lacroix, Dimitri [2 ]
Goyal, Gaurvi [3 ]
Bartolozzi, Chiara [3 ]
Di Nuovo, Alessandro [1 ]
机构
[1] Sheffield Hallam Univ, Sheffield S1 1WB, S Yorkshire, England
[2] Bielefeld Univ, Univ St 25, D-33615 Bielefeld, Germany
[3] Italian Inst Technol, Via Morego 30, I-16163 Genoa, Italy
来源
HUMAN-FRIENDLY ROBOTICS 2024 | 2025年 / 35卷
基金
欧盟地平线“2020”;
关键词
cognitive load; human pose estimation; event camera; HRI; INSTRUCTIONAL-DESIGN; BEHAVIOR;
D O I
10.1007/978-3-031-81688-8_17
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The cognitive load is related to the effort associated with performing a specific task. It can affect learning efficiency, problemsolving abilities, and overall performance. In human-robot collaboration, the capability of a robot to assess cognitive load of humans during a joint task execution can positively affect performance, as robots can adapt its behaviour and mitigate cognitive demands. In this study, we measured behavioural responses to cognitive load, to assess how varying levels of cognitive load affects human body pose and movement. To this aim, we used low-latency, high temporal resolution, compressive event cameras and a lightweight human pose estimation network that can work in realtime at high frequency. Our results demonstrate that participants exhibit stiffer body movements under high cognitive load and more relaxed movements when cognitive load is low. Also, the reaction time is affected by the level of cognitive load. These findings suggest that cognitive load can be effectively inferred from event-driven pose estimation data, offering a non-invasive real-time method to monitor cognitive states and implement online adaptive responses in collaborative tasks.
引用
收藏
页码:229 / 239
页数:11
相关论文
共 28 条
[1]   A framework to estimate cognitive load using physiological data [J].
Ahmad, Muneeb Imtiaz ;
Keller, Ingo ;
Robb, David A. ;
Lohan, Katrin S. .
PERSONAL AND UBIQUITOUS COMPUTING, 2020, 27 (6) :2027-2041
[2]  
Baby SA, 2018, Arxiv, DOI [arXiv:1803.04667, 10.1109/ACPR.2017.136, DOI 10.1109/ACPR.2017.136]
[3]   OpenFace 2.0: Facial Behavior Analysis Toolkit [J].
Baltrusaitis, Tadas ;
Zadeh, Amir ;
Lim, Yao Chong ;
Morency, Louis-Philippe .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :59-66
[4]  
Chaudhary I., 2023, 2023 4 INT C EM TECH
[5]   A Cognitive Load Theory Approach to Defining and Measuring Task Complexity Through Element Interactivity [J].
Chen, Ouhao ;
Paas, Fred ;
Sweller, John .
EDUCATIONAL PSYCHOLOGY REVIEW, 2023, 35 (02)
[6]   Cognitive load theory, educational research, and instructional design: some food for thought [J].
de Jong, Ton .
INSTRUCTIONAL SCIENCE, 2010, 38 (02) :105-134
[7]   The effect of cognitive load on nonverbal behavior in the cognitive interview for suspects [J].
Frosina, P. ;
Logue, M. ;
Book, A. ;
Huizinga, T. ;
Amos, S. ;
Stark, S. .
PERSONALITY AND INDIVIDUAL DIFFERENCES, 2018, 130 :51-58
[8]  
Goyal Gaurvi, 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), P4024, DOI 10.1109/CVPRW59228.2023.00420
[9]  
Gwizdka J., 2010, Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, P219, DOI DOI 10.1145/1962300
[10]  
Haapalainen E., 2010, Proceedings of the 12th ACM international conference on Ubiquitous computing, P301