Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

被引:18
作者
Asgher, Umer [1 ]
Khan, Muhammad Jawad [1 ]
Asif Nizami, Muhammad Hamza [1 ,2 ]
Khalil, Khurram [1 ]
Ahmad, Riaz [1 ,3 ]
Ayaz, Yasar [1 ,4 ]
Naseer, Noman [5 ]
机构
[1] Natl Univ Sci & Technol NUST, Sch Mech & Mfg Engn SMME, Islamabad, Pakistan
[2] Florida A&M Univ, Florida State Univ, Coll Engn, Tallahassee, FL USA
[3] Natl Univ Sci & Technol NUST, Directorate Qual Assurance & Int Collaborat, Islamabad, Pakistan
[4] Natl Univ Sci & Technol, Natl Ctr Artificial Intelligence NCAI, Islamabad, Pakistan
[5] Air Univ, Dept Mechatron & Biomed Engn, Islamabad, Pakistan
关键词
brain machine interface (BMI); brain computer interface (BCI); machine learning (ML); mental workload (MWL); functional near infrared spectroscopy (fNIRS); exoskeleton; bionic actuating behavior; neuroergonomics; COMPUTER INTERFACE; BCI; CLASSIFICATION; MOVEMENT; COMMUNICATION; PERFORMANCE; ACCURACY; ROBOTICS; STROKE; STATE;
D O I
10.3389/fnbot.2021.605751
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.
引用
收藏
页数:20
相关论文
共 123 条
[71]   Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks [J].
Meng, Jianjun ;
Zhang, Shuying ;
Bekyo, Angeliki ;
Olsoe, Jaron ;
Baxter, Bryan ;
He, Bin .
SCIENTIFIC REPORTS, 2016, 6
[72]   Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges [J].
Millan, J. D. R. ;
Rupp, R. ;
Mueller-Putz, G. R. ;
Murray-Smith, R. ;
Giugliemma, C. ;
Tangermann, M. ;
Vidaurre, C. ;
Cincotti, F. ;
Kubler, A. ;
Leeb, R. ;
Neuper, C. ;
Mueller, K. -R. ;
Mattia, D. .
FRONTIERS IN NEUROSCIENCE, 2010, 4
[73]   Neuroimaging-based approaches in the brain-computer interface [J].
Min, Byoung-Kyong ;
Marzelli, Matthew J. ;
Yoo, Seung-Schik .
TRENDS IN BIOTECHNOLOGY, 2010, 28 (11) :552-560
[74]   Assessment of Implicit and Explicit Measures of Mental Workload in Working Situations: Implications for Industry 4.0 [J].
Mingardi, Michele ;
Pluchino, Patrik ;
Bacchin, Davide ;
Rossato, Chiara ;
Gamberini, Luciano .
APPLIED SCIENCES-BASEL, 2020, 10 (18)
[75]   Control of an electrical prosthesis with an SSVEP-based BCI [J].
Mueller-Putz, Gernot R. ;
Pfurtscheller, Gert .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2008, 55 (01) :361-364
[76]   A HIGH-SPEED BRAIN SPELLER USING STEADY-STATE VISUAL EVOKED POTENTIALS [J].
Nakanishi, Masaki ;
Wang, Yijun ;
Wang, Yu-Te ;
Mitsukura, Yasue ;
Jung, Tzyy-Ping .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2014, 24 (06)
[77]   Determining Optimal Feature-Combination for LDA Classification of Functional Near-Infrared Spectroscopy Signals in Brain-Computer Interface Application [J].
Naseer, Noman ;
Noori, Farzan M. ;
Qureshi, Nauman K. ;
Hong, Keum-Shik .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[78]   fNIRS-based brain-computer interfaces: a review [J].
Naseer, Noman ;
Hong, Keum-Shik .
FRONTIERS IN HUMAN NEUROSCIENCE, 2015, 9
[79]   Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain-computer interface [J].
Naseer, Noman ;
Hong, Keum-Shik .
NEUROSCIENCE LETTERS, 2013, 553 :84-89
[80]   Temporal hemodynamic classification of two hands tapping using functional near-infrared spectroscopy [J].
Nguyen Thanh Hai ;
Cuong, Ngo Q. ;
Khoa, Truong Q. Dang ;
Vo Van Toi .
FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7