Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech

被引:183
作者
Brodbeck, Christian [1 ]
Hong, L. Elliot [2 ]
Simon, Jonathan Z. [1 ,3 ,4 ]
机构
[1] Univ Maryland, Inst Syst Res, College Pk, MD 20742 USA
[2] Univ Maryland, Maryland Psychiat Res Ctr, Sch Med, Dept Psychiat, Baltimore, MD 21201 USA
[3] Univ Maryland, Dept Elect & Comp Engn, College Pk, MD 20742 USA
[4] Univ Maryland, Dept Biol, College Pk, MD 20742 USA
基金
美国国家卫生研究院;
关键词
SPOKEN-WORD RECOGNITION; LEXICAL ACCESS; TIME-COURSE; MEG; COMPREHENSION; CORTEX; LOCALIZATION; SEGMENTATION; INTEGRATION; PERCEPTION;
D O I
10.1016/j.cub.2018.10.042
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
During speech perception, a central task of the auditory cortex is to analyze complex acoustic patterns to allow detection of the words that encode a linguistic message [1]. It is generally thought that this process includes at least one intermediate, phonetic, level of representations [2-6], localized bilaterally in the superior temporal lobe [7-9]. Phonetic representations reflect a transition from acoustic to linguistic information, classifying acoustic patterns into linguistically meaningful units, which can serve as input to mechanisms that access abstract word representations [10, 11]. While recent research has identified neural signals arising from successful recognition of individual words in continuous speech [12-15], no explicit neurophysiological signal has been found demonstrating the transition from acoustic and/or phonetic to symbolic, lexical representations. Here, we report a response reflecting the incremental integration of phonetic information for word identification, dominantly localized to the left temporal lobe. The short response latency, approximately 114 ms relative to phoneme onset, suggests that phonetic information is used for lexical processing as soon as it becomes available. Responses also tracked word boundaries, confirming previous reports of immediate lexical segmentation [16, 17]. These new results were further investigated using a cocktail-party paradigm [18, 19] in which participants listened to a mix of two talkers, attending to one and ignoring the other. Analysis indicates neural lexical processing of only the attended, but not the unattended, speech stream. Thus, while responses to acoustic features reflect attention through selective amplification of attended speech, responses consistent with a lexical processing model reveal categorically selective processing.
引用
收藏
页码:3976 / +
页数:13
相关论文
共 66 条
[1]   Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models [J].
Allopenna, PD ;
Magnuson, JS ;
Tanenhaus, MK .
JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) :419-439
[2]   Incremental interpretation at verbs: restricting the domain of subsequent reference [J].
Altmann, GTM ;
Kamide, Y .
COGNITION, 1999, 73 (03) :247-264
[3]   Probability and surprisal in auditory comprehension of morphologically complex words [J].
Balling, Laura Winther ;
Baayen, R. Harald .
COGNITION, 2012, 125 (01) :80-106
[4]  
Boersma P., 1992, Praat: Doing phonetics by computer (6.2.06)
[5]  
Brodbeck C., 2018, EELBRAIN 0 27 ZENODO
[6]   Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension [J].
Brodbeck, Christian ;
Presacco, Alessandro ;
Simon, Jonathan Z. .
NEUROIMAGE, 2018, 172 :162-174
[7]   Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech [J].
Broderick, Michael P. ;
Anderson, Andrew J. ;
Di Liberto, Giovanni M. ;
Crosse, Michael J. ;
Lalor, Edmund C. .
CURRENT BIOLOGY, 2018, 28 (05) :803-+
[8]   Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English [J].
Brysbaert, Marc ;
New, Boris .
BEHAVIOR RESEARCH METHODS, 2009, 41 (04) :977-990
[9]   Categorical speech representation in human superior temporal gyrus [J].
Chang, Edward F. ;
Rieger, Jochem W. ;
Johnson, Keith ;
Berger, Mitchel S. ;
Barbaro, Nicholas M. ;
Knight, Robert T. .
NATURE NEUROSCIENCE, 2010, 13 (11) :1428-U169