Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

被引:18
作者
Asgher, Umer [1 ]
Khan, Muhammad Jawad [1 ]
Asif Nizami, Muhammad Hamza [1 ,2 ]
Khalil, Khurram [1 ]
Ahmad, Riaz [1 ,3 ]
Ayaz, Yasar [1 ,4 ]
Naseer, Noman [5 ]
机构
[1] Natl Univ Sci & Technol NUST, Sch Mech & Mfg Engn SMME, Islamabad, Pakistan
[2] Florida A&M Univ, Florida State Univ, Coll Engn, Tallahassee, FL USA
[3] Natl Univ Sci & Technol NUST, Directorate Qual Assurance & Int Collaborat, Islamabad, Pakistan
[4] Natl Univ Sci & Technol, Natl Ctr Artificial Intelligence NCAI, Islamabad, Pakistan
[5] Air Univ, Dept Mechatron & Biomed Engn, Islamabad, Pakistan
关键词
brain machine interface (BMI); brain computer interface (BCI); machine learning (ML); mental workload (MWL); functional near infrared spectroscopy (fNIRS); exoskeleton; bionic actuating behavior; neuroergonomics; COMPUTER INTERFACE; BCI; CLASSIFICATION; MOVEMENT; COMMUNICATION; PERFORMANCE; ACCURACY; ROBOTICS; STROKE; STATE;
D O I
10.3389/fnbot.2021.605751
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.
引用
收藏
页数:20
相关论文
共 123 条
[1]   A comprehensive review of EEG-based brain-computer interface paradigms [J].
Abiri, Reza ;
Borhani, Soheil ;
Sellers, Eric W. ;
Jiang, Yang ;
Zhao, Xiaopeng .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
[2]  
Abiri R, 2017, IRAN CONF ELECTR ENG, P113, DOI 10.1109/IranianCEE.2017.7985231
[3]   Review and Classification of Emotion Recognition Based on EEG Brain-Computer Interface System Research: A Systematic Review [J].
Al-Nafjan, Abeer ;
Hosny, Manar ;
Al-Ohali, Yousef ;
Al-Wabil, Areej .
APPLIED SCIENCES-BASEL, 2017, 7 (12)
[4]   Passive BCI beyond the lab: current trends and future directions [J].
Arico, P. ;
Borghini, G. ;
Di Flumeri, G. ;
Sciaraffa, N. ;
Babiloni, F. .
PHYSIOLOGICAL MEASUREMENT, 2018, 39 (08)
[5]   Adaptive Automation Triggered by EEG-Based Mental Workload Index: A Passive Brain-Computer Interface Application in Realistic Air Traffic Control Environment [J].
Arico, Pietro ;
Borghini, Gianluca ;
Di Flumeri, Gianluca ;
Colosimo, Alfredo ;
Bonelli, Stefano ;
Golfetti, Alessia ;
Pozzi, Simone ;
Imbert, Jean-Paul ;
Granger, Geraud ;
Benhacene, Railane ;
Babiloni, Fabio .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[6]  
Asgher U., IEEE 2020 3 INT C CO, P1, DOI [10.1109/iCoMET48670.2020.9073799, DOI 10.1109/ICOMET48670.2020.9073799]
[7]   Assessment and Classification of Mental Workload in the Prefrontal Cortex (PFC) Using Fixed-Value Modified Beer-Lambert Law [J].
Asgher, Umer ;
Riaz, Ahmad ;
Naseer, Noman ;
Ayaz, Yasar ;
Khan, Muhammad Jawad ;
Amjad, Muhammad Kamal .
IEEE ACCESS, 2019, 7 :143250-143262
[8]   Enhanced Accuracy for Multiclass Mental Workload Detection Using Long Short-Term Memory for Brain-Computer Interface [J].
Asgher, Umer ;
Khalil, Khurram ;
Khan, Muhammad Jawad ;
Ahmad, Riaz ;
Butt, Shahid Ikramullah ;
Ayaz, Yasar ;
Naseer, Noman ;
Nazir, Salman .
FRONTIERS IN NEUROSCIENCE, 2020, 14
[9]   Analyzing Various Functions of Prefrontal Cortex (PFC) in Decision Making via Brain Imaging Techniques [J].
Asgher, Umer ;
Ahmad, Riaz ;
Ayaz, Yasar ;
Naseer, Noman ;
Ali, Liaqat ;
Arzola Ruiz, Jose ;
Kole, Maureen .
ADVANCES IN CROSS-CULTURAL DECISION MAKING, (AHFE 2017), 2018, 610 :249-260
[10]  
Ayaz H., 2018, NEUROERGONOMICS BRAI, P17, DOI [10.1016/B978-0-12-811926-6.00003-8, DOI 10.1016/B978-0-12-811926-6.00003-8]