Semantic Context Enhances the Early Auditory Encoding of Natural Speech

被引:71
作者
Broderick, Michael P. [1 ,2 ]
Anderson, Andrew J. [3 ,4 ,5 ]
Lalor, Edmund C. [1 ,2 ,3 ,4 ,5 ]
机构
[1] Trinity Coll Dublin, Trinity Ctr Bioengn, Sch Engn, Dublin 2, Ireland
[2] Trinity Coll Dublin, Trinity Coll Inst Neurosci, Dublin 2, Ireland
[3] Univ Rochester, Dept Biomed Engn, 601 Elmwood Ave, Rochester, NY 14627 USA
[4] Univ Rochester, Dept Neurosci, 601 Elmwood Ave, Rochester, NY 14627 USA
[5] Univ Rochester, Del Monte Inst Neurosci, 601 Elmwood Ave, Rochester, NY 14627 USA
基金
爱尔兰科学基金会;
关键词
computational linguistics; EEG; natural speech; perception; semantic processing; top-down effects; CORTICAL ENTRAINMENT; NEURAL RESPONSES; COCKTAIL PARTY; COMPREHENSION; CORTEX; BRAIN; RECOGNITION; PERCEPTION; MECHANISMS; SELECTION;
D O I
10.1523/JNEUROSCI.0584-19.2019
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Speech perception involves the integration of sensory input with expectations based on the context of that speech. Much debate surrounds the issue of whether or not prior knowledge feeds back to affect early auditory encoding in the lower levels of the speech processing hierarchy, or whether perception can be best explained as a purely feedforward process. Although there has been compelling evidence on both sides of this debate, experiments involving naturalistic speech stimuli to address these questions have been lacking. Here, we use a recently introduced method for quantifying the semantic context of speech and relate it to a commonly used method for indexing low-level auditory encoding of speech. The relationship between these measures is taken to be an indication of how semantic context leading up to a word influences how its low-level acoustic and phonetic features are processed. We record EEG from human participants (both male and female) listening to continuous natural speech and find that the early cortical tracking of a word's speech envelope is enhanced by its semantic similarity to its sentential context. Using a forward modeling approach, we find that prediction accuracy of the EEG signal also shows the same effect. Furthermore, this effect shows distinct temporal patterns of correlation depending on the type of speech input representation (acoustic or phonological) used for the model, implicating a top-down propagation of information through the processing hierarchy. These results suggest a mechanism that links top-down prior information with the early cortical entrainment of words in natural, continuous speech.
引用
收藏
页码:7564 / 7575
页数:12
相关论文
共 75 条
[1]   Speech comprehension is correlated with temporal response patterns recorded from auditory cortex [J].
Ahissar, E ;
Nagarajan, S ;
Ahissar, M ;
Protopapas, A ;
Mahncke, H ;
Merzenich, MM .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (23) :13367-13372
[2]   Human cortical responses to the speech envelope [J].
Aiken, Steven J. ;
Picton, Terence W. .
EAR AND HEARING, 2008, 29 (02) :139-157
[3]   Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation [J].
Anderson, Andrew James ;
Binder, Jeffrey R. ;
Fernandino, Leonardo ;
Humphries, Colin J. ;
Conant, Lisa L. ;
Aguilar, Mario ;
Wang, Xixi ;
Doko, Donias ;
Raizada, Rajeev D. S. .
CEREBRAL CORTEX, 2017, 27 (09) :4379-4395
[4]  
[Anonymous], 2016, PRAAT DOING PHONETIC
[5]  
[Anonymous], 1993, LINGUISTIC DATA CONS, DOI DOI 10.35111/17GK-BN40
[6]   Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex [J].
Badre, D ;
Poldrack, RA ;
Paré-Blagoev, EJ ;
Insler, RZ ;
Wagner, AD .
NEURON, 2005, 47 (06) :907-918
[7]  
Baroni M, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P238
[8]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[9]   Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies [J].
Binder, Jeffrey R. ;
Desai, Rutvik H. ;
Graves, William W. ;
Conant, Lisa L. .
CEREBRAL CORTEX, 2009, 19 (12) :2767-2796
[10]   Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech [J].
Brodbeck, Christian ;
Hong, L. Elliot ;
Simon, Jonathan Z. .
CURRENT BIOLOGY, 2018, 28 (24) :3976-+