Structured neuronal encoding and decoding of human speech features

被引:49
作者
Tankus, Ariel [1 ,2 ,3 ]
Fried, Itzhak [1 ,2 ,4 ,5 ]
Shoham, Shy [3 ]
机构
[1] Univ Calif Los Angeles, David Geffen Sch Med, Dept Neurosurg, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Semel Inst Neurosci & Human Behav, Los Angeles, CA 90095 USA
[3] Technion Israel Inst Technol, Fac Biomed Engn, IL-32000 Haifa, Israel
[4] Tel Aviv Med Ctr & Sch Med, Funct Neurosurg Unit, IL-64239 Tel Aviv, Israel
[5] Tel Aviv Univ, Sackler Fac Med, IL-69978 Tel Aviv, Israel
基金
欧洲研究理事会;
关键词
ANTERIOR CINGULATE CORTEX; CONNECTIONS;
D O I
10.1038/ncomms1995
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human speech sounds are produced through a coordinated movement of structures along the vocal tract. Here we show highly structured neuronal encoding of vowel articulation. In medial-frontal neurons, we observe highly specific tuning to individual vowels, whereas superior temporal gyrus neurons have nonspecific, sinusoidally modulated tuning (analogous to motor cortical directional tuning). At the neuronal population level, a decoding analysis reveals that the underlying structure of vowel encoding reflects the anatomical basis of articulatory movements. This structured encoding enables accurate decoding of volitional speech segments and could be applied in the development of brain-machine interfaces for restoring speech in paralysed individuals.
引用
收藏
页数:5
相关论文
共 35 条
[11]  
GEORGOPOULOS AP, 1982, J NEUROSCI, V2, P1527
[12]   A Neuroimaging Study of Premotor Lateralization and Cerebellar Involvement in the Production of Phonemes and Syllables [J].
Ghosh, Satrajit S. ;
Tourville, Jason A. ;
Guenther, Frank H. .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2008, 51 (05) :1183-1202
[13]   A neural theory of speech acquisition and production [J].
Guenther, Frank H. ;
Vladusich, Tony .
JOURNAL OF NEUROLINGUISTICS, 2012, 25 (05) :408-422
[14]   A Wireless Brain-Machine Interface for Real-Time Speech Synthesis [J].
Guenther, Frank H. ;
Brumberg, Jonathan S. ;
Wright, E. Joseph ;
Nieto-Castanon, Alfonso ;
Tourville, Jason A. ;
Panko, Mikhail ;
Law, Robert ;
Siebert, Steven A. ;
Bartels, Jess L. ;
Andreasen, Dinal S. ;
Ehirim, Princewill ;
Mao, Hui ;
Kennedy, Philip R. .
PLOS ONE, 2009, 4 (12)
[15]   An ultra-sparse code underlies the generation of neural sequences in a songbird [J].
Hahnloser, RHR ;
Kozhevnikov, AA ;
Fee, MS .
NATURE, 2002, 419 (6902) :65-70
[16]   SPATIOTEMPORAL STAGES IN FACE AND WORD-PROCESSING .2. DEPTH-RECORDED POTENTIALS IN THE HUMAN FRONTAL AND ROLANDIC CORTICES [J].
HALGREN, E ;
BAUDENA, P ;
HEIT, G ;
CLARKE, M ;
MARINKOVIC, K ;
CHAUVEL, P .
JOURNAL OF PHYSIOLOGY-PARIS, 1994, 88 (01) :51-80
[17]   Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior [J].
Hayden, Benjamin Y. ;
Heilbronner, Sarah R. ;
Pearson, John M. ;
Platt, Michael L. .
JOURNAL OF NEUROSCIENCE, 2011, 31 (11) :4178-4187
[18]   Opinion - The cortical organization of speech processing [J].
Hickok, Gregory ;
Poeppel, David .
NATURE REVIEWS NEUROSCIENCE, 2007, 8 (05) :393-402
[19]   Computational neuroanatomy of speech production [J].
Hickok, Gregory .
NATURE REVIEWS NEUROSCIENCE, 2012, 13 (02) :135-145
[20]   Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization [J].
Hickok, Gregory ;
Houde, John ;
Rong, Feng .
NEURON, 2011, 69 (03) :407-422