Classification of Overt and Covert Speech for Near-Infrared Spectroscopy-Based Brain Computer Interface

被引:3
作者
Kamavuako, Ernest Nlandu [1 ]
Ayub Sheikh, Usman [2 ,3 ]
Gilani, Syed Omer [3 ]
Jamil, Mohsin [3 ,4 ]
Niazi, Imran Khan [5 ,6 ,7 ]
机构
[1] Kings Coll London, Ctr Robot Res, Dept Informat, London WC2B 4BG, England
[2] Basque Ctr Cognit Brain & Language, Donostia San Sebastian 20009, Spain
[3] Natl Univ Sci & Technol, Dept Robot & Artificial Intelligence, Islamabad 24090, Pakistan
[4] Islamic Univ Medina, Fac Engn, Dept Elect Engn, Al Jamiah 42351, Saudi Arabia
[5] New Zealand Coll Chiropract, Ctr Chiropract Res, Auckland 1010, New Zealand
[6] Aalborg Univ, Dept Hlth Sci & Technol, SMI, DK-9100 Aalborg, Denmark
[7] AUT Univ, Hlth & Rehabil Res Inst, Auckland 1010, New Zealand
关键词
brain computer interface; near infrared spectroscopy; overt and covert speech; unsupervised feature extraction; Broca's area; decoding speech; LOCKED-IN SYNDROME; BROCAS AREA; NONINVASIVE ASSESSMENT; PREFRONTAL CORTEX; LANGUAGE; OXYGENATION; ACTIVATION; COMMUNICATION; TOPOGRAPHY; LEARN;
D O I
10.3390/s18092989
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
People suffering from neuromuscular disorders such as locked-in syndrome (LIS) are left in a paralyzed state with preserved awareness and cognition. In this study, it was hypothesized that changes in local hemodynamic activity, due to the activation of Broca's area during overt/covert speech, can be harnessed to create an intuitive Brain Computer Interface based on Near-Infrared Spectroscopy (NIRS). A 12-channel square template was used to cover inferior frontal gyrus and changes in hemoglobin concentration corresponding to six aloud (overtly) and six silently (covertly) spoken words were collected from eight healthy participants. An unsupervised feature extraction algorithm was implemented with an optimized support vector machine for classification. For all participants, when considering overt and covert classes regardless of words, classification accuracy of 92.88 +/- 18.49% was achieved with oxy-hemoglobin (O2Hb) and 95.14 +/- 5.39% with deoxy-hemoglobin (HHb) as a chromophore. For a six-active-class problem of overtly spoken words, 88.19 +/- 7.12% accuracy was achieved for O2Hb and 78.82 +/- 15.76% for HHb. Similarly, for a six-active-class classification of covertly spoken words, 79.17 +/- 14.30% accuracy was achieved with O2Hb and 86.81 +/- 9.90% with HHb as an absorber. These results indicate that a control paradigm based on covert speech can be reliably implemented into future Brain-Computer Interfaces (BCIs) based on NIRS.
引用
收藏
页数:10
相关论文
共 40 条
[1]   Assessing the potential of electrodermal activity as an alternative access pathway [J].
Blain, Stefanie ;
Mihailidis, Alex ;
Chau, Tom .
MEDICAL ENGINEERING & PHYSICS, 2008, 30 (04) :498-505
[2]   Locked-In Syndrome in Children: Report of Five Cases and Review of the Literature [J].
Bruno, Marie-Aurelie ;
Schnakers, Caroline ;
Damas, Francois ;
Pellas, Frederic ;
Lutte, Isabelle ;
Bernheim, Jan ;
Majerus, Steve ;
Moonen, Gustave ;
Goldman, Serge ;
Laureys, Steven .
PEDIATRIC NEUROLOGY, 2009, 41 (04) :237-246
[3]   Functional assessment of Broca's area using near infrared spectroscopy in humans [J].
Cannestra, AF ;
Wartenburger, I ;
Obrig, H ;
Villringer, A ;
Toga, AW .
NEUROREPORT, 2003, 14 (15) :1961-1965
[4]   Locked-in syndrome: Improvement in the prognosis after an early intensive multidisciplinary rehabilitation [J].
Casanova, E ;
Lazzari, RE ;
Lotta, S ;
Mazzucchi, A .
ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION, 2003, 84 (06) :862-867
[5]  
Coyle S., 2005, THESIS
[6]   Prefrontal hypooxygenation during language processing assessed with near-infrared spectroscopy [J].
Fallgatter, AJ ;
Müller, TJ ;
Strik, WK .
NEUROPSYCHOBIOLOGY, 1998, 37 (04) :215-218
[7]   BRAIN COMMUNICATION IN A COMPLETELY LOCKED-IN PATIENT USING BEDSIDE NEAR-INFRARED SPECTROSCOPY [J].
Gallegos-Ayala, Guillermo ;
Furdea, Adrian ;
Takano, Kouji ;
Ruf, Carolin A. ;
Flor, Herta ;
Birbaumer, Niels .
NEUROLOGY, 2014, 82 (21) :1930-1932
[8]   Review of language organisation in bilingual patients: what can we learn from direct brain mapping? [J].
Giussani, C. ;
Roux, F. -E. ;
Lubrano, V. ;
Gaini, S. M. ;
Bello, L. .
ACTA NEUROCHIRURGICA, 2007, 149 (11) :1109-1116
[9]   Noninvasive assessment of changes in cytochrome-c oxidase oxidation in human subjects during visual stimulation [J].
Heekeren, HR ;
Kohl, M ;
Obrig, H ;
Wenzel, R ;
von Pannwitz, W ;
Matcher, SJ ;
Dirnagl, U ;
Cooper, CE ;
Villringer, A .
JOURNAL OF CEREBRAL BLOOD FLOW AND METABOLISM, 1999, 19 (06) :592-603
[10]   Optical topography during a Go-NoGo task assessed with multi-channel near-infrared spectroscopy [J].
Herrmann, MJ ;
Plichta, MM ;
Ehlis, AC ;
Fallgatter, AJ .
BEHAVIOURAL BRAIN RESEARCH, 2005, 160 (01) :135-140