The speech neuroprosthesis

被引:11
|
作者
Silva, Alexander B. [1 ,2 ]
Littlejohn, Kaylo T. [1 ,2 ,3 ]
Liu, Jessie R. [1 ,2 ]
Moses, David A. [1 ,2 ]
Chang, Edward F. [1 ,2 ]
机构
[1] Univ Calif San Francisco, Dept Neurol Surg, San Francisco, CA 94115 USA
[2] Univ Calif San Francisco, Weill Inst Neurosci, San Francisco, CA 94115 USA
[3] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
BRAIN-COMPUTER INTERFACE; HUMAN SENSORIMOTOR CORTEX; LOCKED-IN SYNDROME; NEURAL-NETWORK; MOTOR; REPRESENTATION; COMMUNICATION; ORGANIZATION; DYSARTHRIA; APHASIA;
D O I
10.1038/s41583-024-00819-9
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Loss of speech after paralysis is devastating, but circumventing motor-pathway injury by directly decoding speech from intact cortical activity has the potential to restore natural communication and self-expression. Recent discoveries have defined how key features of speech production are facilitated by the coordinated activity of vocal-tract articulatory and motor-planning cortical representations. In this Review, we highlight such progress and how it has led to successful speech decoding, first in individuals implanted with intracranial electrodes for clinical epilepsy monitoring and subsequently in individuals with paralysis as part of early feasibility clinical trials to restore speech. We discuss high-spatiotemporal-resolution neural interfaces and the adaptation of state-of-the-art speech computational algorithms that have driven rapid and substantial progress in decoding neural activity into text, audible speech, and facial movements. Although restoring natural speech is a long-term goal, speech neuroprostheses already have performance levels that surpass communication rates offered by current assistive-communication technology. Given this accelerated rate of progress in the field, we propose key evaluation metrics for speed and accuracy, among others, to help standardize across studies. We finish by highlighting several directions to more fully explore the multidimensional feature space of speech and language, which will continue to accelerate progress towards a clinically viable speech neuroprosthesis. A clinically viable speech neuroprosthesis could restore natural speech to individuals with vocal-tract paralysis. In this Review, Silva et al. discuss rapid progress in neural interfaces and computational algorithms for decoding speech from cortical activity and propose evaluation metrics to help standardize speech neuroprostheses.
引用
收藏
页码:473 / 492
页数:20
相关论文
共 50 条
  • [1] Toward a Speech Neuroprosthesis
    Chang, Edward F.
    Anumanchipalli, Gopala K.
    JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2020, 323 (05): : 413 - 414
  • [2] An Accurate and Rapidly Calibrating Speech Neuroprosthesis
    Card, Nicholas S.
    Wairagkar, Maitreyee
    Iacobacci, Carrina
    Hou, Xianda
    Singer-Clark, Tyler
    Willett, Francis R.
    Kunz, Erin M.
    Fan, Chaofei
    Nia, Maryam Vahdati
    Deo, Darrel R.
    Srinivasan, Aparna
    Choi, Eun Young
    Glasser, Matthew F.
    Hochberg, Leigh R.
    Henderson, Jaimie M.
    Shahlaie, Kiarash
    Stavisky, Sergey D.
    Brandman, David M.
    NEW ENGLAND JOURNAL OF MEDICINE, 2024, 391 (07): : 609 - 618
  • [3] A high-performance speech neuroprosthesis
    Willett, Francis R.
    Kunz, Erin M.
    Fan, Chaofei
    Avansino, Donald T.
    Wilson, Guy H.
    Choi, Eun Young
    Kamdar, Foram
    Glasser, Matthew F.
    Hochberg, Leigh R.
    Druckmann, Shaul
    Shenoy, Krishna V.
    Henderson, Jaimie M.
    NATURE, 2023, 620 (7976) : 1031 - 1036
  • [4] A high-performance speech neuroprosthesis
    Francis R. Willett
    Erin M. Kunz
    Chaofei Fan
    Donald T. Avansino
    Guy H. Wilson
    Eun Young Choi
    Foram Kamdar
    Matthew F. Glasser
    Leigh R. Hochberg
    Shaul Druckmann
    Krishna V. Shenoy
    Jaimie M. Henderson
    Nature, 2023, 620 : 1031 - 1036
  • [5] Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria
    Moses, David A.
    Metzger, Sean L.
    Liu, Jessie R.
    Anumanchipalli, Gopala K.
    Makin, Joseph G.
    Sun, Pengfei F.
    Chartier, Josh
    Dougherty, Maximilian E.
    Liu, Patricia M.
    Abrams, Gary M.
    Tu-Chan, Adelyn
    Ganguly, Karunesh
    Chang, Edward F.
    NEW ENGLAND JOURNAL OF MEDICINE, 2021, 385 (03): : 217 - 227
  • [6] Towards a Real-Time Speech Neuroprosthesis to Restore Speech in a Person With ALS
    Wairagkar, Maitreyee
    Card, Nicholas
    Iacobacci, Carrina
    Hochberg, Leigh R.
    Stavisky, Sergey
    Brandman, David M.
    NEUROSURGERY, 2025, 71 : 58 - 58
  • [7] A high-performance neuroprosthesis for speech decoding and avatar control
    Metzger, Sean L.
    Littlejohn, Kaylo T.
    Silva, Alexander B.
    Moses, David A.
    Seaton, Margaret P.
    Wang, Ran
    Dougherty, Maximilian E.
    Liu, Jessie R.
    Wu, Peter
    Berger, Michael A.
    Zhuravleva, Inga
    Tu-Chan, Adelyn
    Ganguly, Karunesh
    Anumanchipalli, Gopala K.
    Chang, Edward F.
    NATURE, 2023, 620 (7976) : 1037 - +
  • [8] A bilingual speech neuroprosthesis driven by cortical articulatory representations shared between languages
    Silva, Alexander B.
    Liu, Jessie R.
    Metzger, Sean L.
    Bhaya-Grossman, Ilina
    Dougherty, Maximilian E.
    Seaton, Margaret P.
    Littlejohn, Kaylo T.
    Tu-Chan, Adelyn
    Ganguly, Karunesh
    Moses, David A.
    Chang, Edward F.
    NATURE BIOMEDICAL ENGINEERING, 2024, 8 (08): : 977 - +
  • [9] Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis
    Metzger, Sean L.
    Liu, Jessie R.
    Moses, David A.
    Dougherty, Maximilian E.
    Seaton, Margaret P.
    Littlejohn, Kaylo T.
    Chartier, Josh
    Anumanchipalli, Gopala K.
    Tu-Chan, Adelyn
    Ganguly, Karunesh
    Chang, Edward F.
    NATURE COMMUNICATIONS, 2022, 13 (01)
  • [10] Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis
    Sean L. Metzger
    Jessie R. Liu
    David A. Moses
    Maximilian E. Dougherty
    Margaret P. Seaton
    Kaylo T. Littlejohn
    Josh Chartier
    Gopala K. Anumanchipalli
    Adelyn Tu-Chan
    Karunesh Ganguly
    Edward F. Chang
    Nature Communications, 13