Design and evaluation of AR-based adaptive human-computer interaction cognitive training

被引:0
作者
Chu, Man [1 ,2 ]
Qu, Jing [1 ,2 ]
Zou, Tan [1 ,2 ]
Li, Qinbiao [3 ]
Bu, Lingguo [1 ,2 ]
Shen, Yiran [2 ]
机构
[1] Shandong Univ, Joint SDU NTU Ctr Artificial Intelligence Res C FA, Jinan 250101, Peoples R China
[2] Shandong Univ, Sch Software, Jinan 250101, Peoples R China
[3] Hong Kong Polytech Univ, Dept Aeronaut & Aviat Engn, Human Factors & Ergon Lab, Hong Kong, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Augmented reality; Cognitive training; Adaptive human-computer interaction (HCI); Evaluation methods; Functional near-infrared spectroscopy; NEAR-INFRARED SPECTROSCOPY; PREFRONTAL CORTEX ACTIVITY; VIRTUAL-REALITY; REHABILITATION; PERFORMANCE; MOTIVATION; DIFFICULTY; ADULTS;
D O I
10.1016/j.ijhcs.2025.103504
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
As human-computer interaction (HCI) technology advances, the use of augmented reality (AR) in cognitive training is becoming more prevalent. However, traditional training methods often apply a one-size-fits-all approach, failing to accommodate the varied training needs of individuals with different cognitive levels. Additionally, most HCI systems use subjective questionnaires for evaluation, which can be influenced by the subjects' emotional and mental states. To overcome these challenges, this study developed an AR-based adaptive HCI cognitive training system that dynamically adjusts task difficulty based on real-time user performance. We used multi-source data to empirically validate the effectiveness of adaptive HCI in cognitive training. Specifically, we recorded functional Near-Infrared Spectroscopy (fNIRS) data, movement data, task performance, and subjective feedback from 22 elderly participants, dividing them into two groups-low cognitive group and normal cognitive group. The results showed that the system exerted a significant influence on brain functional connectivity (FC) associated with cognition, movement, and vision. Changes in FC may highlight the benefits of adaptive HCI training strategies. Furthermore, participants with normal cognitive abilities significantly outperformed their low cognitive counterparts in task performance. In conclusion, this study designed and evaluated an AR-based adaptive HCI cognitive training system that ensures personalized training. It demonstrated the feasibility of adaptive HCI strategies in cognitive rehabilitation by incorporating physiological and behavioral data, thereby enhancing the precision of quantitative assessments for HCI systems.
引用
收藏
页数:13
相关论文
共 74 条
[1]   Dynamic Difficulty Using Brain Metrics of Workload [J].
Afergan, Daniel ;
Peck, Evan M. ;
Solovey, Erin T. ;
Jenkins, Andrew ;
Hincks, Samuel W. ;
Brown, Eli T. ;
Chang, Remco ;
Jacob, Robert J. K. .
32ND ANNUAL ACM CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2014), 2014, :3797-3806
[2]   Effects of Workstation Type on Mental Stress: fNIRS Study [J].
Alyan, Emad ;
Saad, Naufal M. ;
Kamel, Nidal .
HUMAN FACTORS, 2021, 63 (07) :1230-1255
[3]   Applications of functional Near Infrared Spectroscopy as a Brain Optical Imaging Modality for Rehabilitation [J].
An, Jinung ;
Lee, Seung Hyun ;
Lee, Yoo Jung ;
Jin, Sang Hyeon ;
Jang, Gwanghee .
PROCEEDINGS OF 2014 INTERNATIONAL SYMPOSIUM ON OPTOMECHATRONIC TECHNOLOGIES (ISOT), 2014, :50-56
[4]   Using Adaptive Difficulty to Optimize Videogame-Based Training Performance: The Moderating Role of Personality [J].
Bauer, Kristina N. ;
Brusso, Robert C. ;
Orvis, Karin A. .
MILITARY PSYCHOLOGY, 2012, 24 (02) :148-165
[5]   Augmented assistive technology: the importance of tailoring technology solutions for people living with dementia at home [J].
Berrett, James ;
de Kruiff, Alison ;
Pedell, Sonja ;
Reilly, Ann .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2022, 165
[6]   Augmented Reality Cube Game for Cognitive Training: An Interaction Study [J].
Boletsis, Costas ;
Mccallum, Simon .
PHEALTH 2014, 2014, 200 :81-87
[7]   The Feasibility of Augmented Reality as a Support Tool for Motor Rehabilitation [J].
Butaslac, Isidro, III ;
Luchetti, Alessandro ;
Parolin, Edoardo ;
Fujimoto, Yuichiro ;
Kanbara, Masayuki ;
De Cecco, Mariolino ;
Kato, Hirokazu .
AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2020, PT II, 2020, 12243 :165-173
[8]  
Cameirao MS, 2017, 2017 INTERNATIONAL CONFERENCE ON VIRTUAL REHABILITATION (ICVR)
[9]   MENTOR: A Physiologically Controlled Tutoring System [J].
Chaouachi, Maher ;
Jraidi, Imene ;
Frasson, Claude .
USER MODELING, ADAPTATION AND PERSONALIZATION, 2015, 9146 :56-67
[10]   Effects of incorporating virtual reality training intervention into health care on cognitive function and wellbeing in older adults with cognitive impairment: A randomized controlled trial [J].
Chiu, Hui -Min ;
Hsu, Mei-Chi ;
Ouyang, Wen-Chen .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2023, 170