Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech

被引:236
作者
Broderick, Michael P. [1 ,2 ]
Anderson, Andrew J. [3 ,4 ]
Di Liberto, Giovanni M. [1 ,2 ,5 ,6 ]
Crosse, Michael J. [1 ,2 ,7 ,8 ]
Lalor, Edmund C. [1 ,2 ,3 ,4 ]
机构
[1] Trinity Coll Dublin, Trinity Ctr Bioengn, Sch Engn, Dublin 2, Ireland
[2] Trinity Coll Dublin, Inst Neurosci, Dublin 2, Ireland
[3] Univ Rochester, Dept Biomed Engn, Dept Neurosci, Rochester, NY 14627 USA
[4] Univ Rochester, Del Monte Inst Neurosci, Rochester, NY 14627 USA
[5] CNRS, Lab Syst Perceptifs, 29 Rue Ulm, F-75005 Paris, France
[6] PSL Res Univ, Dept Etud Cognit, ENS, 60 Rue Mazarine, F-75006 Paris, France
[7] Albert Einstein Coll Med, Dept Pediat, Bronx, NY 10461 USA
[8] Albert Einstein Coll Med, Dept Neurosci, Bronx, NY 10461 USA
基金
爱尔兰科学基金会;
关键词
CORTICAL ENTRAINMENT; COCKTAIL PARTY; REPRESENTATION; ATTENTION; RESPONSES; COMPONENT; SELECTION; PATTERNS;
D O I
10.1016/j.cub.2018.01.080
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
People routinely hear and understand speech at rates of 120-200 words per minute [1, 2]. Thus, speech comprehension must involve rapid, online neural mechanisms that process words' meanings in an approximately time-locked fashion. However, electrophysiological evidence for such time-locked processing has been lacking for continuous speech. Although valuable insights into semantic processing have been provided by the "N400 component'' of the event-related potential [3-6], this literature has been dominated by paradigms using incongruous words within specially constructed sentences, with less emphasis on natural, narrative speech comprehension. Building on the discovery that cortical activity "tracks'' the dynamics of running speech [7-9] and psycholinguistic work demonstrating [10-12] and modeling [13-15] how context impacts on word processing, we describe a new approach for deriving an electrophysiological correlate of natural speech comprehension. We used a computational model [16] to quantify the meaning carried by words based on how semantically dissimilar they were to their preceding context and then regressed this measure against electroencephalographic (EEG) data recorded from subjects as they listened to narrative speech. This produced a prominent negativity at a time lag of 200-600 ms on centro-parietal EEG channels, characteristics common to the N400. Applying this approach to EEG datasets involving time-reversed speech, cocktail party attention, and audiovisual speech-in-noise demonstrated that this response was very sensitive to whether or not subjects understood the speech they heard. These findings demonstrate that, when successfully comprehending natural speech, the human brain responds to the contextual semantic content of each word in a relatively time-locked fashion.
引用
收藏
页码:803 / +
页数:10
相关论文
共 50 条
[1]   Speech comprehension is correlated with temporal response patterns recorded from auditory cortex [J].
Ahissar, E ;
Nagarajan, S ;
Ahissar, M ;
Protopapas, A ;
Mahncke, H ;
Merzenich, MM .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2001, 98 (23) :13367-13372
[2]   Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation [J].
Anderson, Andrew James ;
Binder, Jeffrey R. ;
Fernandino, Leonardo ;
Humphries, Colin J. ;
Conant, Lisa L. ;
Aguilar, Mario ;
Wang, Xixi ;
Doko, Donias ;
Raizada, Rajeev D. S. .
CEREBRAL CORTEX, 2017, 27 (09) :4379-4395
[3]  
[Anonymous], 1987, Voice and Speech Processing
[4]   Semantic processing of unattended speech in dichotic listening [J].
Aydelott, Jennifer ;
Jamaluddin, Zahra ;
Pearce, Stefanie Nixon .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (02) :964-975
[5]  
Baroni M, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P238
[6]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[7]  
Broadbent D., 1958, PERCEPTION COMMUNICA, DOI 10.1037/10037-000
[9]   The cocktail party phenomenon revisited: The importance of working memory capacity [J].
Conway, ARA ;
Cowan, N ;
Bunting, MF .
PSYCHONOMIC BULLETIN & REVIEW, 2001, 8 (02) :331-335
[10]   The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli [J].
Crosse, Michael J. ;
Di Liberto, Giovanni M. ;
Bednar, Adam ;
Lalor, Edmund C. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10