Novel fNIRS study on homogeneous symmetric feature-based transfer learning for brain-computer interface

被引:25
作者
Khalil, Khurram [1 ]
Asgher, Umer [1 ,2 ]
Ayaz, Yasar [1 ]
机构
[1] Natl Univ Sci & Technol NUST, Sch Mech & Mfg Engn SMME, Natl Ctr Artificial Intelligence NCAI, Islamabad 44000, Pakistan
[2] Natl Univ Sci & Technol NUST, Coll Elect & Mech Engn, Dept Mechatron Engn, Islamabad 44000, Pakistan
关键词
NEAR-INFRARED SPECTROSCOPY; CLASSIFICATION;
D O I
10.1038/s41598-022-06805-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The brain-computer interface (BCI) provides an alternate means of communication between the brain and external devices by recognizing the brain activities and translating them into external commands. The functional Near-Infrared Spectroscopy (fNIRS) is becoming popular as a non-invasive modality for brain activity detection. The recent trends show that deep learning has significantly enhanced the performance of the BCI systems. But the inherent bottleneck for deep learning (in the domain of BCI) is the requirement of the vast amount of training data, lengthy recalibrating time, and expensive computational resources for training deep networks. Building a high-quality, large-scale annotated dataset for deep learning-based BCI systems is exceptionally tedious, complex, and expensive. This study investigates the novel application of transfer learning for fNIRS-based BCI to solve three objective functions (concerns), i.e., the problem of insufficient training data, reduced training time, and increased accuracy. We applied symmetric homogeneous feature-based transfer learning on convolutional neural network (CNN) designed explicitly for fNIRS data collected from twenty-six (26) participants performing the n-back task. The results suggested that the proposed method achieves the maximum saturated accuracy sooner and outperformed the traditional CNN model on averaged accuracy by 25.58% in the exact duration of training time, reducing the training time, recalibrating time, and computational resources.
引用
收藏
页数:12
相关论文
共 56 条
[21]   A Study on CNN Transfer Learning for Image Classification [J].
Hussain, Mahbub ;
Bird, Jordan J. ;
Faria, Diego R. .
ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS (UKCI), 2019, 840 :191-202
[22]   Evaluation of various mental task combinations for near-infrared spectroscopy-based brain-computer interfaces [J].
Hwang, Han-Jeong ;
Lim, Jeong-Hwan ;
Kim, Do-Won ;
Im, Chang-Hwan .
JOURNAL OF BIOMEDICAL OPTICS, 2014, 19 (07)
[23]   Transfer Learning in Brain-Computer Interfaces [J].
Jayaram, Vinay ;
Alamgir, Morteza ;
Altun, Yasemin ;
Schoelkopf, Bernhard ;
Grosse-Wentrup, Moritz .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2016, 11 (01) :20-31
[24]   Composite Common Spatial Pattern for Subject-to-Subject Transfer [J].
Kang, Hyohyeong ;
Nam, Yunjun ;
Choi, Seungjin .
IEEE SIGNAL PROCESSING LETTERS, 2009, 16 (08) :683-686
[25]   Hybrid EEG-fNIRS-Based Eight-Command Decoding for BCI: Application to Quadcopter Control [J].
Khan, Muhammad Jawad ;
Hong, Keum-Shik .
FRONTIERS IN NEUROROBOTICS, 2017, 11
[26]  
Krauledat M., 2007, Advances in Neural Information Processing Systems, P753
[27]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[28]   Application of Covariate Shift Adaptation Techniques in Brain-Computer Interfaces [J].
Li, Yan ;
Kambara, Hiroyuki ;
Koike, Yasuharu ;
Sugiyama, Masashi .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (06) :1318-1324
[29]   Towards an EEG-based brain-computer interface for online robot control [J].
Li, Yantao ;
Zhou, Gang ;
Graham, Daniel ;
Holtzhauer, Andrew .
MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (13) :7999-8017
[30]   A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update [J].
Lotte, F. ;
Bougrain, L. ;
Cichocki, A. ;
Clerc, M. ;
Congedo, M. ;
Rakotomamonjy, A. ;
Yger, F. .
JOURNAL OF NEURAL ENGINEERING, 2018, 15 (03)