Using Machine Learning to Train a Wearable Device for Measuring Students' Cognitive Load during Problem-Solving Activities Based on Electrodermal Activity, Body Temperature, and Heart Rate: Development of a Cognitive Load Tracker for Both Personal and Classroom Use

被引:31
作者
Romine, William L. [1 ]
Schroeder, Noah L. [2 ]
Graft, Josephine [1 ]
Yang, Fan [3 ]
Sadeghi, Reza [4 ]
Zabihimayvan, Mahdieh [5 ]
Kadariya, Dipesh [3 ]
Banerjee, Tanvi [3 ]
机构
[1] Wright State Univ, Dept Biol Sci, Dayton, OH 45435 USA
[2] Wright State Univ, Dept Leadership Studies Educ & Org, Dayton, OH 45435 USA
[3] Wright State Univ, Dept Comp Sci & Engn, Dayton, OH 45435 USA
[4] Univ New Haven, Dept Elect & Comp Engn & Comp Sci, West Haven, CT 06516 USA
[5] Cent Connecticut State Univ, Dept Comp Sci, New Britain, CT 06050 USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
cognitive load; machine learning; wearable sensor; studying; learning analytics;
D O I
10.3390/s20174833
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Automated tracking of physical fitness has sparked a health revolution by allowing individuals to track their own physical activity and health in real time. This concept is beginning to be applied to tracking of cognitive load. It is well known that activity in the brain can be measured through changes in the body's physiology, but current real-time measures tend to be unimodal and invasive. We therefore propose the concept of a wearable educational fitness (EduFit) tracker. We use machine learning with physiological data to understand how to develop a wearable device that tracks cognitive load accurately in real time. In an initial study, we found that body temperature, skin conductance, and heart rate were able to distinguish between (i) a problem solving activity (high cognitive load), (ii) a leisure activity (moderate cognitive load), and (iii) daydreaming (low cognitive load) with high accuracy in the test dataset. In a second study, we found that these physiological features can be used to predict accurately user-reported mental focus in the test dataset, even when relatively small numbers of training data were used. We explain how these findings inform the development and implementation of a wearable device for temporal tracking and logging a user's learning activities and cognitive load.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 31 条
[1]  
[Anonymous], 2010, P 12 ACM INT C UB CO
[2]   Using Electroencephalography to Measure Cognitive Load [J].
Antonenko, Pavlo ;
Paas, Fred ;
Grabner, Roland ;
van Gog, Tamara .
EDUCATIONAL PSYCHOLOGY REVIEW, 2010, 22 (04) :425-438
[3]  
Boucsein W., 2012, Electrodermal Activity, DOI DOI 10.1007/978-1-4757-5093-5
[4]   Direct measurement of cognitive load in multimedia learning [J].
Brünken, R ;
Plass, JL ;
Leutner, D .
EDUCATIONAL PSYCHOLOGIST, 2003, 38 (01) :53-61
[5]   RAPID DECLINE IN BODY-TEMPERATURE BEFORE SLEEP - FLUFFING THE PHYSIOLOGICAL PILLOW [J].
CAMPBELL, SS ;
BROUGHTON, RJ .
CHRONOBIOLOGY INTERNATIONAL, 1994, 11 (02) :126-131
[6]   Measuring mental workload using physiological measures: A systematic review [J].
Charles, Rebecca L. ;
Nixon, Jim .
APPLIED ERGONOMICS, 2019, 74 :221-232
[7]  
Cook A. E., 2017, COGNITIVE LOAD MEASU, P112, DOI [10.4324/9781315296258-8, DOI 10.4324/9781315296258-8]
[8]   Cognitive load theory, educational research, and instructional design: some food for thought [J].
de Jong, Ton .
INSTRUCTIONAL SCIENCE, 2010, 38 (02) :105-134
[9]  
Deterding S., 2018, Roleplaying game studies: A transmedia approach, pviii
[10]   Unobtrusive assessment of students’ emotional engagement during lectures using electrodermal activity sensors [J].
Di Lascio, Elena ;
Gashi, Shkurta ;
Santini, Silvia .
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 2 (03)