Motor Training Using Mental Workload (MWL) With an Assistive Soft Exoskeleton System: A Functional Near-Infrared Spectroscopy (fNIRS) Study for Brain-Machine Interface (BMI)

被引:14
|
作者
Asgher, Umer [1 ]
Khan, Muhammad Jawad [1 ]
Asif Nizami, Muhammad Hamza [1 ,2 ]
Khalil, Khurram [1 ]
Ahmad, Riaz [1 ,3 ]
Ayaz, Yasar [1 ,4 ]
Naseer, Noman [5 ]
机构
[1] Natl Univ Sci & Technol NUST, Sch Mech & Mfg Engn SMME, Islamabad, Pakistan
[2] Florida A&M Univ, Florida State Univ, Coll Engn, Tallahassee, FL USA
[3] Natl Univ Sci & Technol NUST, Directorate Qual Assurance & Int Collaborat, Islamabad, Pakistan
[4] Natl Univ Sci & Technol, Natl Ctr Artificial Intelligence NCAI, Islamabad, Pakistan
[5] Air Univ, Dept Mechatron & Biomed Engn, Islamabad, Pakistan
来源
FRONTIERS IN NEUROROBOTICS | 2021年 / 15卷
关键词
brain machine interface (BMI); brain computer interface (BCI); machine learning (ML); mental workload (MWL); functional near infrared spectroscopy (fNIRS); exoskeleton; bionic actuating behavior; neuroergonomics; COMPUTER INTERFACE; BCI; CLASSIFICATION; MOVEMENT; COMMUNICATION; PERFORMANCE; ACCURACY; ROBOTICS; STROKE; STATE;
D O I
10.3389/fnbot.2021.605751
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mental workload is a neuroergonomic human factor, which is widely used in planning a system's safety and areas like brain-machine interface (BMI), neurofeedback, and assistive technologies. Robotic prosthetics methodologies are employed for assisting hemiplegic patients in performing routine activities. Assistive technologies' design and operation are required to have an easy interface with the brain with fewer protocols, in an attempt to optimize mobility and autonomy. The possible answer to these design questions may lie in neuroergonomics coupled with BMI systems. In this study, two human factors are addressed: designing a lightweight wearable robotic exoskeleton hand that is used to assist the potential stroke patients with an integrated portable brain interface using mental workload (MWL) signals acquired with portable functional near-infrared spectroscopy (fNIRS) system. The system may generate command signals for operating a wearable robotic exoskeleton hand using two-state MWL signals. The fNIRS system is used to record optical signals in the form of change in concentration of oxy and deoxygenated hemoglobin (HbO and HbR) from the pre-frontal cortex (PFC) region of the brain. Fifteen participants participated in this study and were given hand-grasping tasks. Two-state MWL signals acquired from the PFC region of the participant's brain are segregated using machine learning classifier-support vector machines (SVM) to utilize in operating a robotic exoskeleton hand. The maximum classification accuracy is 91.31%, using a combination of mean-slope features with an average information transfer rate (ITR) of 1.43. These results show the feasibility of a two-state MWL (fNIRS-based) robotic exoskeleton hand (BMI system) for hemiplegic patients assisting in the physical grasping tasks.
引用
收藏
页数:20
相关论文
共 48 条
  • [1] Brain-machine interfaces using functional near-infrared spectroscopy: a review
    Hong, Keum-Shik
    Ghafoor, Usman
    Khan, M. Jawad
    ARTIFICIAL LIFE AND ROBOTICS, 2020, 25 (02) : 204 - 218
  • [2] How Stress Affects Functional Near-Infrared Spectroscopy (fNIRS) Measurements of Mental Workload
    Alsuraykh, Norah H.
    Maior, Horia A.
    Wilson, Max L.
    Tennent, Paul
    Sharples, Sarah
    CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [3] Brain-Computer Interfacing Using Functional Near-Infrared Spectroscopy (fNIRS)
    Paulmurugan, Kogulan
    Vijayaragavan, Vimalan
    Ghosh, Sayantan
    Padmanabhan, Parasuraman
    Gulyas, Balazs
    BIOSENSORS-BASEL, 2021, 11 (10):
  • [4] Involvement of the prefrontal cortex in motor sequence learning: A functional near-infrared spectroscopy (fNIRS) study
    Polskaia, Nadia
    St-Amant, Gabrielle
    Fraser, Sarah
    Lajoie, Yves
    BRAIN AND COGNITION, 2023, 166
  • [5] A Study on Information Transfer Rate by Brain-Computer Interface (BCI) using Functional Near-Infrared Spectroscopy (fNIRS)
    Shin, Jaeyoung
    Kang, Sungyong
    Sung, Minkyu
    Kim, Joohwan
    Kim, Yongjung
    Kim, Jihyun
    Jeong, Jichai
    2013 IEEE INTERNATIONAL WINTER WORKSHOP ON BRAIN-COMPUTER INTERFACE (BCI), 2013, : 32 - 33
  • [6] Optical Imaging of Brain Motor Cortex Activation DuringWrist Movement Using Functional Near-Infrared Spectroscopy (fNIRS)
    Jalalvandi, Maziar
    Alam, Nader Riahi
    Sharini, Hamid
    ARCHIVES OF NEUROSCIENCE, 2019, 6
  • [7] Brain–machine interfaces using functional near-infrared spectroscopy: a review
    Keum-Shik Hong
    Usman Ghafoor
    M. Jawad Khan
    Artificial Life and Robotics, 2020, 25 : 204 - 218
  • [8] The Investigation of Brain-computer Interface for Motor Imagery and Execution Using Functional Near-infrared Spectroscopy
    Zhang, Zhen
    Jiao, Xuejun
    Xu, Fengang
    Jiang, Jin
    Yang, Hanjun
    Cao, Yong
    Fu, Jiahao
    INTERNATIONAL CONFERENCE ON INNOVATIVE OPTICAL HEALTH SCIENCE, 2017, 0245
  • [9] Functional near-infrared spectroscopy (fNIRS) of brain function during active balancing using a video game system
    Karim, Helmet
    Schmidt, Benjamin
    Dart, Dwight
    Beluk, Nancy
    Huppert, Theodore
    GAIT & POSTURE, 2012, 35 (03) : 367 - 372
  • [10] Hand motor learning in a musical context and prefrontal cortex hemodynamic response: a functional near-infrared spectroscopy (fNIRS) study
    Heinze, Rafael Alves
    Vanzella, Patricia
    Zimeo Morais, Guilherme Augusto
    Sato, Joao Ricardo
    COGNITIVE PROCESSING, 2019, 20 (04) : 507 - 513