Latent neural dynamics encode temporal context in speech

被引:2
|
作者
Stephen, Emily P. [1 ,2 ]
Li, Yuanning [1 ,3 ]
Metzger, Sean [1 ]
Oganian, Yulia [1 ,4 ]
Chang, Edward F. [1 ]
机构
[1] Univ Calif San Francisco, Dept Neurol Surg, San Francisco, CA 94143 USA
[2] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
[3] ShanghaiTech Univ, Sch Biomed Engn, Shanghai, Peoples R China
[4] Univ Tubingen, Ctr Integrat Neurosci, Tubingen, Germany
关键词
Electrocorticography; Superior temporal gyrus; Auditory; Reduced-rank regression; Latent state; OSCILLATIONS; RESPONSES; FIELD; CORTEX; COMPREHENSION; NEURONS; SPIKING; SOUND; BAND; HZ;
D O I
10.1016/j.heares.2023.108838
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Direct neural recordings from human auditory cortex have demonstrated encoding for acoustic-phonetic features of consonants and vowels. Neural responses also encode distinct acoustic amplitude cues related to timing, such as those that occur at the onset of a sentence after a silent period or the onset of the vowel in each syllable. Here, we used a group reduced rank regression model to show that distributed cortical responses support a low-dimensional latent state representation of temporal context in speech. The timing cues each capture more unique variance than all other phonetic features and exhibit rotational or cyclical dynamics in latent space from activity that is widespread over the superior temporal gyrus. We propose that these spatially distributed timing signals could serve to provide temporal context for, and possibly bind across time, the concurrent processing of individual phonetic features, to compose higher-order phonological (e.g. word-level) representations. & COPY; 2023 Published by Elsevier B.V.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Human EEG and Recurrent Neural Networks Exhibit Common Temporal Dynamics During Speech Recognition
    Hashemnia, Saeedeh
    Grasse, Lukas
    Soni, Shweta
    Tata, Matthew S.
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2021, 15
  • [2] Temporal context in speech processing and attentional stream selection: A behavioral and neural perspective
    Golumbic, Elana M. Zion
    Poeppel, David
    Schroeder, Charles E.
    BRAIN AND LANGUAGE, 2012, 122 (03) : 151 - 161
  • [3] Temporal neural dynamics of understanding communicative intentions from speech prosody
    Gao, Panke
    Jiang, Zhufang
    Yang, Yufang
    Zheng, Yuanyi
    Feng, Gangyi
    Li, Xiaoqing
    NEUROIMAGE, 2024, 299
  • [4] Neural Dynamics of Context-sensitive Adjustments in Cognitive Flexibility
    Siqi-Liu, Audrey
    Egner, Tobias
    Woldorff, Marty G.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2022, 34 (03) : 480 - 494
  • [5] Body Patches in Inferior Temporal Cortex Encode Categories with Different Temporal Dynamics
    Kumar, Satwant
    Vogels, Rufin
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2019, 31 (11) : 1699 - 1709
  • [6] Neural correlates of sine-wave speech intelligibility in human frontal and temporal cortex
    Khoshkhoo, Sattar
    Leonard, Matthew K.
    Mesgarani, Nima
    Chang, Edward F.
    BRAIN AND LANGUAGE, 2018, 187 : 83 - 91
  • [7] Neural Speech Tracking in the Theta and in the Delta Frequency Band Differentially Encode Clarity and Comprehension of Speech in Noise
    Etard, Octave
    Reichenbach, Tobias
    JOURNAL OF NEUROSCIENCE, 2019, 39 (29) : 5750 - 5759
  • [8] Speech intelligibility changes the temporal evolution of neural speech tracking
    Chen, Ya-Ping
    Schmidt, Fabian
    Keitel, Anne
    Roesch, Sebastian
    Hauswald, Anne
    Weisz, Nathan
    NEUROIMAGE, 2023, 268
  • [9] Neuronal populations in the occipital cortex of the blind synchronize to the temporal dynamics of speech
    Van Ackeren, Markus Johannes
    Barbero, Francesca M.
    Mattioni, Stefania
    Bottini, Roberto
    Collignon, Olivier
    ELIFE, 2018, 7
  • [10] Neural dynamics of speech and non-speech motor planning
    Lancheros, M.
    Jouen, A-L.
    Laganaro, M.
    BRAIN AND LANGUAGE, 2020, 203