Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech

被引:163
作者
Brodbeck, Christian [1 ]
Hong, L. Elliot [2 ]
Simon, Jonathan Z. [1 ,3 ,4 ]
机构
[1] Univ Maryland, Inst Syst Res, College Pk, MD 20742 USA
[2] Univ Maryland, Maryland Psychiat Res Ctr, Sch Med, Dept Psychiat, Baltimore, MD 21201 USA
[3] Univ Maryland, Dept Elect & Comp Engn, College Pk, MD 20742 USA
[4] Univ Maryland, Dept Biol, College Pk, MD 20742 USA
基金
美国国家卫生研究院;
关键词
SPOKEN-WORD RECOGNITION; LEXICAL ACCESS; TIME-COURSE; MEG; COMPREHENSION; CORTEX; LOCALIZATION; SEGMENTATION; INTEGRATION; PERCEPTION;
D O I
10.1016/j.cub.2018.10.042
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
During speech perception, a central task of the auditory cortex is to analyze complex acoustic patterns to allow detection of the words that encode a linguistic message [1]. It is generally thought that this process includes at least one intermediate, phonetic, level of representations [2-6], localized bilaterally in the superior temporal lobe [7-9]. Phonetic representations reflect a transition from acoustic to linguistic information, classifying acoustic patterns into linguistically meaningful units, which can serve as input to mechanisms that access abstract word representations [10, 11]. While recent research has identified neural signals arising from successful recognition of individual words in continuous speech [12-15], no explicit neurophysiological signal has been found demonstrating the transition from acoustic and/or phonetic to symbolic, lexical representations. Here, we report a response reflecting the incremental integration of phonetic information for word identification, dominantly localized to the left temporal lobe. The short response latency, approximately 114 ms relative to phoneme onset, suggests that phonetic information is used for lexical processing as soon as it becomes available. Responses also tracked word boundaries, confirming previous reports of immediate lexical segmentation [16, 17]. These new results were further investigated using a cocktail-party paradigm [18, 19] in which participants listened to a mix of two talkers, attending to one and ignoring the other. Analysis indicates neural lexical processing of only the attended, but not the unattended, speech stream. Thus, while responses to acoustic features reflect attention through selective amplification of attended speech, responses consistent with a lexical processing model reveal categorically selective processing.
引用
收藏
页码:3976 / +
页数:13
相关论文
共 66 条
  • [1] Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models
    Allopenna, PD
    Magnuson, JS
    Tanenhaus, MK
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) : 419 - 439
  • [2] Incremental interpretation at verbs: restricting the domain of subsequent reference
    Altmann, GTM
    Kamide, Y
    [J]. COGNITION, 1999, 73 (03) : 247 - 264
  • [3] Probability and surprisal in auditory comprehension of morphologically complex words
    Balling, Laura Winther
    Baayen, R. Harald
    [J]. COGNITION, 2012, 125 (01) : 80 - 106
  • [4] Boersma P., 1992, Praat: Doing phonetics by computer (6.2.06)
  • [5] Brodbeck C., 2018, EELBRAIN 0 27 ZENODO
  • [6] Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension
    Brodbeck, Christian
    Presacco, Alessandro
    Simon, Jonathan Z.
    [J]. NEUROIMAGE, 2018, 172 : 162 - 174
  • [7] Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech
    Broderick, Michael P.
    Anderson, Andrew J.
    Di Liberto, Giovanni M.
    Crosse, Michael J.
    Lalor, Edmund C.
    [J]. CURRENT BIOLOGY, 2018, 28 (05) : 803 - +
  • [8] Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English
    Brysbaert, Marc
    New, Boris
    [J]. BEHAVIOR RESEARCH METHODS, 2009, 41 (04) : 977 - 990
  • [9] Categorical speech representation in human superior temporal gyrus
    Chang, Edward F.
    Rieger, Jochem W.
    Johnson, Keith
    Berger, Mitchel S.
    Barbaro, Nicholas M.
    Knight, Robert T.
    [J]. NATURE NEUROSCIENCE, 2010, 13 (11) : 1428 - U169