Decoding the temporal dynamics of spoken word and nonword processing from EEG

被引:10
作者
McMurray, Bob [1 ,2 ]
Sarrett, McCall E. [3 ]
Chiu, Samantha [4 ]
Black, Alexis K. [5 ]
Wang, Alice [6 ]
Canale, Rebecca [7 ]
Aslin, Richard N. [8 ,9 ,10 ]
机构
[1] Univ Iowa, Dept Psychol & Brain Sci, Dept Commun Sci & Disorders, Dept Linguist, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Otolaryngol, Iowa City, IA 52242 USA
[3] Univ Iowa, Interdisciplinary Grad Program Neurosci, Iowa City, IA USA
[4] Univ Iowa, Dept Psychol & Brain Sci, 278 PBSB, Iowa City, IA 52242 USA
[5] Univ British Columbia, Sch Audiol & Speech Sci, Haskins Labs, Vancouver, BC, Canada
[6] Univ Oregon, Haskins Labs, Dept Psychol, Eugene, OR 97403 USA
[7] Univ Connecticut, Dept Psychol Sci, Haskins Labs, Storrs, CT USA
[8] Yale Univ, Dept Psychol, Haskins Labs, New Haven, CT USA
[9] Yale Univ, Ctr Child Study, New Haven, CT 06520 USA
[10] Univ Connecticut, Dept Psychol, Storrs, CT USA
关键词
Spoken Word Recognition; Speech Decoding; EEG; Machine Learning; TIME-COURSE; LEXICAL COMPETITION; PATTERN-ANALYSIS; TRACE MODEL; RECOGNITION; PERCEPTION; INTEGRATION; TRACKING; SIGNAL; SOUND;
D O I
10.1016/j.neuroimage.2022.119457
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage ) or a similar sounding competitor ( badger ), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.
引用
收藏
页数:19
相关论文
共 82 条
  • [1] Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models
    Allopenna, PD
    Magnuson, JS
    Tanenhaus, MK
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 1998, 38 (04) : 419 - 439
  • [2] [Anonymous], 2010, LME4 LINEAR MIXED EF
  • [3] The development of lexical competition in written- and spoken-word recognition
    Apfelbaum, Keith S.
    Goodwin, Claire
    Blomquist, Christina
    McMurray, Bob
    [J]. QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2023, 76 (01) : 196 - 219
  • [4] Audacity Team, 2015, AUD FREE AUD ED REC
  • [5] Dissociable Decoding of Spatial Attention and Working Memory from EEG Oscillations and Sustained Potentials
    Bae, Gi-Yeul
    Luck, Steven J.
    [J]. JOURNAL OF NEUROSCIENCE, 2018, 38 (02) : 409 - 422
  • [6] Neural Decoding Reveals Concurrent Phonemic and Subphonemic Representations of Speech Across Tasks
    Beach, Sara D.
    Ozernov-Palchik, Ola
    May, Sidney C.
    Centanni, Tracy M.
    Gabrieli, John D. E.
    Pantazis, Dimitrios
    [J]. NEUROBIOLOGY OF LANGUAGE, 2021, 2 (02): : 254 - 279
  • [7] Effects of Aging and Noise on Real-Time Spoken Word Recognition: Evidence From Eye Movements
    Ben-David, Boaz M.
    Chambers, Craig G.
    Daneman, Meredyth
    Pichora-Fuller, M. Kathleen
    Reingold, Eyal M.
    Schneider, Bruce A.
    [J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2011, 54 (01): : 243 - 262
  • [8] Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception
    Blank, Helen
    Davis, Matthew H.
    [J]. PLOS BIOLOGY, 2016, 14 (11)
  • [9] The perception of voice onset time: An fMRI investigation of phonetic category structure
    Blumstein, SE
    Myers, EB
    Rissman, J
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (09) : 1353 - 1366
  • [10] Boersma P, 2013, Praat: Doing phonetics by computer Computer software