Latent neural dynamics encode temporal context in speech

被引:2
|
作者
Stephen, Emily P. [1 ,2 ]
Li, Yuanning [1 ,3 ]
Metzger, Sean [1 ]
Oganian, Yulia [1 ,4 ]
Chang, Edward F. [1 ]
机构
[1] Univ Calif San Francisco, Dept Neurol Surg, San Francisco, CA 94143 USA
[2] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
[3] ShanghaiTech Univ, Sch Biomed Engn, Shanghai, Peoples R China
[4] Univ Tubingen, Ctr Integrat Neurosci, Tubingen, Germany
关键词
Electrocorticography; Superior temporal gyrus; Auditory; Reduced-rank regression; Latent state; OSCILLATIONS; RESPONSES; FIELD; CORTEX; COMPREHENSION; NEURONS; SPIKING; SOUND; BAND; HZ;
D O I
10.1016/j.heares.2023.108838
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Direct neural recordings from human auditory cortex have demonstrated encoding for acoustic-phonetic features of consonants and vowels. Neural responses also encode distinct acoustic amplitude cues related to timing, such as those that occur at the onset of a sentence after a silent period or the onset of the vowel in each syllable. Here, we used a group reduced rank regression model to show that distributed cortical responses support a low-dimensional latent state representation of temporal context in speech. The timing cues each capture more unique variance than all other phonetic features and exhibit rotational or cyclical dynamics in latent space from activity that is widespread over the superior temporal gyrus. We propose that these spatially distributed timing signals could serve to provide temporal context for, and possibly bind across time, the concurrent processing of individual phonetic features, to compose higher-order phonological (e.g. word-level) representations. & COPY; 2023 Published by Elsevier B.V.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Inferring Latent Dynamics Underlying Neural Population Activity via Neural Differential Equations
    Kim, Timothy Doyeon
    Luo, Thomas Zhihao
    Pillow, Jonathan W.
    Brody, Carlos D.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] Effect of Speech Rate on Neural Tracking of Speech
    Mueller, Jana Annina
    Wendt, Dorothea
    Kollmeier, Birger
    Debener, Stefan
    Brand, Thomas
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [23] Temporal modulations in speech and music
    Ding, Nai
    Patel, Aniruddh D.
    Chen, Lin
    Butler, Henry
    Luo, Cheng
    Poeppel, David
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2017, 81 : 181 - 187
  • [24] Neural encoding of the speech envelope by children with developmental dyslexia
    Power, Alan J.
    Colling, Lincoln J.
    Mead, Natasha
    Barnes, Lisa
    Goswami, Usha
    BRAIN AND LANGUAGE, 2016, 160 : 1 - 10
  • [25] Dissecting neural computations in the human auditory pathway using deep neural networks for speech
    Li, Yuanning
    Anumanchipalli, Gopala K.
    Mohamed, Abdelrahman
    Chen, Peili
    Carney, Laurel H.
    Lu, Junfeng
    Wu, Jinsong
    Chang, Edward F.
    NATURE NEUROSCIENCE, 2023, 26 (12) : 2213 - 2225
  • [26] Temporal Dynamics of Neural Responses in Human Visual Cortex
    Groen, Iris I. A.
    Piantoni, Giovanni
    Montenegro, Stephanie
    Flinker, Adeen
    Devore, Sasha
    Devinsky, Orrin
    Doyle, Werner
    Dugan, Patricia
    Friedman, Daniel
    Ramsey, Nick F.
    Petridou, Natalia
    Winawer, Jonathan
    JOURNAL OF NEUROSCIENCE, 2022, 42 (40) : 7562 - 7580
  • [27] Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition
    Stevenson, Ryan A.
    James, Thomas W.
    NEUROIMAGE, 2009, 44 (03) : 1210 - 1223
  • [28] Temporal dynamics of the neural representation of hue and luminance polarity
    Hermann, Katherine L.
    Singh, Shridhar R.
    Rosenthal, Isabelle A.
    Pantazis, Dimitrios
    Conway, Bevil R.
    NATURE COMMUNICATIONS, 2022, 13 (01)
  • [29] Unraveling Spatial-Spectral Dynamics of Speech Categorization Speed Using Convolutional Neural Networks
    Moinuddin, Kazi Ashraf
    Havugimana, Felix
    Al-Fahad, Rakib
    Bidelman, Gavin M. M.
    Yeasin, Mohammed
    BRAIN SCIENCES, 2023, 13 (01)
  • [30] Neural Univariate Activity and Multivariate Pattern in the Posterior Superior Temporal Sulcus Differentially Encode Facial Expression and Identity
    Yang, Zetian
    Zhen, Zonglei
    Huang, Lijie
    Kong, Xiang-zhen
    Wang, Xu
    Song, Yiying
    Liu, Jia
    SCIENTIFIC REPORTS, 2016, 6