Semantic Context Enhances the Early Auditory Encoding of Natural Speech

被引:71
作者
Broderick, Michael P. [1 ,2 ]
Anderson, Andrew J. [3 ,4 ,5 ]
Lalor, Edmund C. [1 ,2 ,3 ,4 ,5 ]
机构
[1] Trinity Coll Dublin, Trinity Ctr Bioengn, Sch Engn, Dublin 2, Ireland
[2] Trinity Coll Dublin, Trinity Coll Inst Neurosci, Dublin 2, Ireland
[3] Univ Rochester, Dept Biomed Engn, 601 Elmwood Ave, Rochester, NY 14627 USA
[4] Univ Rochester, Dept Neurosci, 601 Elmwood Ave, Rochester, NY 14627 USA
[5] Univ Rochester, Del Monte Inst Neurosci, 601 Elmwood Ave, Rochester, NY 14627 USA
基金
爱尔兰科学基金会;
关键词
computational linguistics; EEG; natural speech; perception; semantic processing; top-down effects; CORTICAL ENTRAINMENT; NEURAL RESPONSES; COCKTAIL PARTY; COMPREHENSION; CORTEX; BRAIN; RECOGNITION; PERCEPTION; MECHANISMS; SELECTION;
D O I
10.1523/JNEUROSCI.0584-19.2019
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Speech perception involves the integration of sensory input with expectations based on the context of that speech. Much debate surrounds the issue of whether or not prior knowledge feeds back to affect early auditory encoding in the lower levels of the speech processing hierarchy, or whether perception can be best explained as a purely feedforward process. Although there has been compelling evidence on both sides of this debate, experiments involving naturalistic speech stimuli to address these questions have been lacking. Here, we use a recently introduced method for quantifying the semantic context of speech and relate it to a commonly used method for indexing low-level auditory encoding of speech. The relationship between these measures is taken to be an indication of how semantic context leading up to a word influences how its low-level acoustic and phonetic features are processed. We record EEG from human participants (both male and female) listening to continuous natural speech and find that the early cortical tracking of a word's speech envelope is enhanced by its semantic similarity to its sentential context. Using a forward modeling approach, we find that prediction accuracy of the EEG signal also shows the same effect. Furthermore, this effect shows distinct temporal patterns of correlation depending on the type of speech input representation (acoustic or phonological) used for the model, implicating a top-down propagation of information through the processing hierarchy. These results suggest a mechanism that links top-down prior information with the early cortical entrainment of words in natural, continuous speech.
引用
收藏
页码:7564 / 7575
页数:12
相关论文
共 75 条
[11]   Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech [J].
Broderick, Michael P. ;
Anderson, Andrew J. ;
Di Liberto, Giovanni M. ;
Crosse, Michael J. ;
Lalor, Edmund C. .
CURRENT BIOLOGY, 2018, 28 (05) :803-+
[12]   Whatever next? Predictive brains, situated agents, and the future of cognitive science [J].
Clark, Andy .
BEHAVIORAL AND BRAIN SCIENCES, 2013, 36 (03) :181-204
[13]   The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli [J].
Crosse, Michael J. ;
Di Liberto, Giovanni M. ;
Bednar, Adam ;
Lalor, Edmund C. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[14]   Eye Can Hear Clearly Now: Inverse Effectiveness in Natural Audiovisual Speech Processing Relies on Long-Term Crossmodal Temporal Integration [J].
Crosse, Michael J. ;
Di Liberto, Giovanni M. ;
Lalor, Edmund C. .
JOURNAL OF NEUROSCIENCE, 2016, 36 (38) :9888-9895
[15]   Hearing speech sounds: Top-down influences on the interface between audition and speech perception [J].
Davis, Matthew H. ;
Johnsrude, Ingrid S. .
HEARING RESEARCH, 2007, 229 (1-2) :132-147
[16]   Does Semantic Context Benefit Speech Understanding through "Top-Down" Processes? Evidence from Time-resolved Sparse fMRI [J].
Davis, Matthew H. ;
Ford, Michael A. ;
Kherif, Ferath ;
Johnsrude, Ingrid S. .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (12) :3914-3932
[17]  
Davis MH, 2003, J NEUROSCI, V23, P3423
[18]   Probabilistic word pre-activation during language comprehension inferred from electrical brain activity [J].
DeLong, KA ;
Urbach, TP ;
Kutas, M .
NATURE NEUROSCIENCE, 2005, 8 (08) :1117-1121
[19]   EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis [J].
Delorme, A ;
Makeig, S .
JOURNAL OF NEUROSCIENCE METHODS, 2004, 134 (01) :9-21
[20]   Phoneme and word recognition in the auditory ventral stream [J].
DeWitt, Iain ;
Rauschecker, Josef P. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (08) :E505-E514