Neurolinguistics Research Advancing Development of a Direct-Speech Brain-Computer Interface

被引:64
作者
Cooney, Ciaran [1 ]
Folli, Raffaella [2 ]
Coyle, Damien [1 ]
机构
[1] Ulster Univ, Intelligent Syst Res Ctr, Derry, North Ireland
[2] Ulster Univ, Inst Res Social Sci, Jordanstown, North Ireland
基金
英国工程与自然科学研究理事会;
关键词
INFERIOR FRONTAL-CORTEX; INNER SPEECH; CONTROLLED RETRIEVAL; LEXICAL ACCESS; WORD RETRIEVAL; NEURAL BASIS; TIME-COURSE; LANGUAGE; CLASSIFICATION; OVERT;
D O I
10.1016/j.isci.2018.09.016
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
A direct-speech brain-computer interface (DS-BCI) acquires neural signals corresponding to imagined speech, then processes and decodes these signals to produce a linguistic output in the form of phonemes, words, or sentences. Recent research has shown the potential of neurolinguistics to enhance decoding approaches to imagined speech with the inclusion of semantics and phonology in experimental procedures. As neurolinguistics research findings are beginning to be incorporated within the scope of DS-BCI research, it is our view that a thorough understanding of imagined speech, and its relationship with overt speech, must be considered an integral feature of research in this field. With a focus on imagined speech, we provide a review of the most important neurolinguistics research informing the field of DS-BCI and suggest how this research may be utilized to improve current experimental protocols and decoding techniques. Our review of the literature supports a cross-disciplinary approach to DS-BCI research, in which neurolinguistics concepts and methods are utilized to aid development of a naturalistic mode of communication.
引用
收藏
页码:103 / 125
页数:23
相关论文
共 151 条
[21]  
BRIGHAM K, 2010, BIOINF BIOM ENG ICBB, P1, DOI [10.1109/icbbe.2010.5515807, DOI 10.1109/ICBBE.2010.5515807, 10.1109/ICBBE.2010.5515807]
[22]   Investigating the inner speech of people who stutter: Evidence for (and against) the Covert Repair Hypothesis [J].
Brocklehurst, Paul H. ;
Corley, Martin .
JOURNAL OF COMMUNICATION DISORDERS, 2011, 44 (02) :246-260
[23]   Spatio-Temporal Progression of Cortical Activity Related to Continuous Overt and Covert Speech Production in a Reading Task [J].
Brumberg, Jonathan S. ;
Krusienski, Dean J. ;
Chakrabarti, Shreya ;
Gunduz, Aysegul ;
Brunner, Peter ;
Ritaccio, Anthony L. ;
Schalk, Gerwin .
PLOS ONE, 2016, 11 (11)
[24]   Classification of intended phoneme production from chronic intracortical microelectrode recordings in speech-motor cortex [J].
Brumberg, Jonathan S. ;
Wright, E. Joe ;
Andreasen, Dinal S. ;
Guenther, Frank H. ;
Kennedy, Philip R. .
FRONTIERS IN NEUROSCIENCE, 2011, 5 :1-12
[25]  
Chakrabarti S, 2015, BIOMED ENG LETT, V5, P10
[26]   RETRACTED: Brain-Computer Interface-Based Communication in the Completely Locked-In State (Publication with Expression of Concern. See vol. 17, 2019) (Retracted article. See vol. 17, 2019) [J].
Chaudhary, Ujwal ;
Xia, Bin ;
Silvoni, Stefano ;
Cohen, Leonardo G. ;
Birbaumer, Niels .
PLOS BIOLOGY, 2017, 15 (01)
[27]  
Chi X., 2011, Int. J. Bioelectromagn., V13, P201
[28]   Error Biases in Inner and Overt Speech: Evidence From Tongue Twisters [J].
Corley, Martin ;
Brocklehurst, Paul H. ;
Moat, H. Susannah .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2011, 37 (01) :162-175
[29]  
D'Zmura M, 2009, LECT NOTES COMPUT SC, V5610, P40, DOI 10.1007/978-3-642-02574-7_5
[30]   Single-trial classification of vowel speech imagery using common spatial patterns [J].
DaSalla, Charles S. ;
Kambara, Hiroyuki ;
Sato, Makoto ;
Koike, Yasuharu .
NEURAL NETWORKS, 2009, 22 (09) :1334-1339