A high-performance speech neuroprosthesis

被引:137
|
作者
Willett, Francis R. [1 ]
Kunz, Erin M. [2 ,3 ]
Fan, Chaofei [4 ]
Avansino, Donald T. [1 ]
Wilson, Guy H. [5 ]
Choi, Eun Young [6 ]
Kamdar, Foram [6 ]
Glasser, Matthew F. [7 ,8 ]
Hochberg, Leigh R. [9 ,10 ,11 ,12 ]
Druckmann, Shaul [13 ]
Shenoy, Krishna V. [1 ,2 ,3 ,13 ,14 ,15 ]
Henderson, Jaimie M. [3 ,6 ]
机构
[1] Stanford Univ, Howard Hughes Med Inst, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
[3] Stanford Univ, Wu Tsai Neurosci Inst, Stanford, CA USA
[4] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[5] Stanford Univ, Dept Neurosci, Stanford, CA 94305 USA
[6] Stanford Univ, Dept Neurosurg, Stanford, CA USA
[7] Washington Univ St Louis, Dept Neurosci, St Louis, MO USA
[8] Washington Univ St Louis, Dept Radiol, St Louis, MO USA
[9] Providence VA Med Ctr, VA RR&D Ctr Neurorestorat & Neurotechnol Rehabil, Providence, RI USA
[10] Brown Univ, Sch Engn, Providence, RI USA
[11] Brown Univ, Carney Inst Brain Sci, Providence, RI USA
[12] Harvard Med Sch, Massachusetts Gen Hosp, Dept Neurol, Ctr Neurotechnol & Neurorecovery, Boston, MA USA
[13] Stanford Univ, Dept Neurobiol, Stanford, CA USA
[14] Stanford Univ, Dept Bioengn, Stanford, CA USA
[15] Stanford Univ, Biox Program, Stanford, CA USA
关键词
BROCAS AREA; LANGUAGE; REGIONS; CORTEX;
D O I
10.1038/s41586-023-06377-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Speech brain-computer interfaces (BCIs) have the potential to restore rapid communication to people with paralysis by decoding neural activity evoked by attempted speech into text(1,2) or sound(3,4). Early demonstrations, although promising, have not yet achieved accuracies sufficiently high for communication of unconstrained sentences from a large vocabulary(1-7). Here we demonstrate a speech-to-text BCI that records spiking activity from intracortical microelectrode arrays. Enabled by these high-resolution recordings, our study participant-who can no longer speak intelligibly owing to amyotrophic lateral sclerosis-achieved a 9.1% word error rate on a 50-word vocabulary (2.7times fewer errors than the previous state-of-the-art speech BCI2) and a 23.8% word error rate on a 125,000-word vocabulary (the first successful demonstration, to our knowledge, of large-vocabulary decoding). Our participant's attempted speech was decoded at 62words per minute, which is 3.4times as fast as the previous record(8) and begins to approach the speed of natural conversation (160words per minute(9)). Finally, we highlight two aspects of the neural code for speech that are encouraging for speech BCIs: spatially intermixed tuning to speech articulators that makes accurate decoding possible from only a small region of cortex, and a detailed articulatory representation of phonemes that persists years after paralysis. These results show a feasible path forward for restoring rapid communication to people with paralysis who can no longer speak.
引用
收藏
页码:1031 / 1036
页数:18
相关论文
共 50 条
  • [21] VoIP Smart Speech Encoding Mechanism Using High-Performance Computing
    Nagaraja, G. S.
    Koundinya, Anjan K.
    Thippeswamy, G.
    Mahesh, G.
    Hegde, Vinay V.
    SMART INTELLIGENT COMPUTING AND APPLICATIONS, VOL 2, 2020, 160 : 577 - 583
  • [22] High-performance robust speech recognition using stereo training data
    Deng, L
    Acero, A
    Jiang, L
    Droppo, J
    Huang, XD
    2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-VI, PROCEEDINGS: VOL I: SPEECH PROCESSING 1; VOL II: SPEECH PROCESSING 2 IND TECHNOL TRACK DESIGN & IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS NEURALNETWORKS FOR SIGNAL PROCESSING; VOL III: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING, 2001, : 301 - 304
  • [23] FLEXIBLE, HIGH-PERFORMANCE SPEECH SYNTHESIZER USING CUSTOM NMOS CIRCUITRY
    CALDWELL, J
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1978, 64 : S72 - S72
  • [24] LDVT - HIGH-PERFORMANCE MINICOMPUTER FOR REAL-TIME SPEECH PROCESSING
    BLANKENSHIP, PE
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 1975, 11 (05) : 980 - 980
  • [25] HIGH-PERFORMANCE CARS DEMAND HIGH-PERFORMANCE MATERIALS
    MISKA, KH
    MATERIALS ENGINEERING, 1974, 79 (05): : 22 - 24
  • [26] WHICH HIGH-PERFORMANCE MATERIAL FOR HIGH-PERFORMANCE FASTENING
    ROACH, TA
    MATERIALS ENGINEERING, 1981, 94 (01): : 60 - 64
  • [27] Teaching high-performance computing on a high-performance cluster
    Bernreuther, M
    Brenk, M
    Bungartz, HJ
    Mundani, RP
    Muntean, IL
    COMPUTATIONAL SCIENCE - ICCS 2005, PT 2, 2005, 3515 : 1 - 9
  • [28] HIGH-PERFORMANCE COMPUTING MEETS HIGH-PERFORMANCE MEDICINE
    Verma, Anurag
    Huffman, Jennifer
    Torkamani, Ali
    Madduri, Ravi
    BIOCOMPUTING 2023, PSB 2023, 2023, : 541 - 545
  • [29] Towards a Real-Time Speech Neuroprosthesis to Restore Speech in a Person With ALS
    Wairagkar, Maitreyee
    Card, Nicholas
    Iacobacci, Carrina
    Hochberg, Leigh R.
    Stavisky, Sergey
    Brandman, David M.
    NEUROSURGERY, 2025, 71 : 58 - 58
  • [30] Adaptive Microphone Array Processing for High-Performance Speech Recognition in Car Environment
    Hong, Jungpyo
    Han, Seungho
    Jeong, Sangbae
    Hahn, Minsoo
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2011, 57 (01) : 260 - 266