Neural oscillations reflect the individual differences in the temporal perception of audiovisual speech

被引:0
作者
Jiang, Zeliang [1 ]
An, Xingwei [1 ]
Liu, Shuang [1 ]
Yin, Erwei [1 ,2 ,3 ]
Yan, Ye [1 ,2 ,3 ]
Ming, Dong [1 ]
机构
[1] Tianjin Univ, Acad Med Engn & Translat Med, Tianjin 300072, Peoples R China
[2] Acad Mil Sci AMS, Def Innovat Inst, Beijing 100071, Peoples R China
[3] Tianjin Artificial Intelligence Innovat Ctr TAIIC, Tianjin 300457, Peoples R China
基金
中国国家自然科学基金;
关键词
audiovisual speech; electroencephalography (EEG); individual difference; neural oscillations; temporal perception; ALPHA OSCILLATIONS; BINDING WINDOW; INTEGRATION; EEG; RENORMALIZATION; ATTENTION; DYNAMICS;
D O I
10.1093/cercor/bhad304
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Multisensory integration occurs within a limited time interval between multimodal stimuli. Multisensory temporal perception varies widely among individuals and involves perceptual synchrony and temporal sensitivity processes. Previous studies explored the neural mechanisms of individual differences for beep-flash stimuli, whereas there was no study for speech. In this study, 28 subjects (16 male) performed an audiovisual speech/ba/simultaneity judgment task while recording their electroencephalography. We examined the relationship between prestimulus neural oscillations (i.e. the pre-pronunciation movement-related oscillations) and temporal perception. The perceptual synchrony was quantified using the Point of Subjective Simultaneity and temporal sensitivity using the Temporal Binding Window. Our results revealed dissociated neural mechanisms for individual differences in Temporal Binding Window and Point of Subjective Simultaneity. The frontocentral delta power, reflecting top-down attention control, is positively related to the magnitude of individual auditory leading Temporal Binding Windows (auditory Temporal Binding Windows; LTBWs), whereas the parieto-occipital theta power, indexing bottom-up visual temporal attention specific to speech, is negatively associated with the magnitude of individual visual leading Temporal Binding Windows (visual Temporal Binding Windows; RTBWs). In addition, increased left frontal and bilateral temporoparietal occipital alpha power, reflecting general attentional states, is associated with increased Points of Subjective Simultaneity. Strengthening attention abilities might improve the audiovisual temporal perception of speech and further impact speech integration.
引用
收藏
页码:10575 / 10583
页数:9
相关论文
共 72 条
[1]   Cortical oscillations and sensory predictions [J].
Arnal, Luc H. ;
Giraud, Anne-Lise .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (07) :390-398
[2]   Dual Neural Routing of Visual Facilitation in Speech Processing [J].
Arnal, Luc H. ;
Morillon, Benjamin ;
Kell, Christian A. ;
Giraud, Anne-Lise .
JOURNAL OF NEUROSCIENCE, 2009, 29 (43) :13445-13453
[3]   Are alpha oscillations instrumental in multisensory synchrony perception? [J].
Bastiaansen, Marcel ;
Berberyan, Hermine ;
Stekelenburg, Jeroen J. ;
Schoffelen, Jan Mathijs ;
Vroomen, Jean .
BRAIN RESEARCH, 2020, 1734
[4]  
Biau E., 2020, LEFT FRONTAL MOTOR D, V11
[5]   MEG Activity in Visual and Auditory Cortices Represents Acoustic Speech-Related Information during Silent Lip Reading [J].
Brohl, Felix ;
Keitel, Anne ;
Kayser, Christoph .
ENEURO, 2022, 9 (03)
[6]   Individual Differences in Alpha Frequency Drive Crossmodal Illusory Perception [J].
Cecere, Roberto ;
Rees, Geraint ;
Romei, Vincenzo .
CURRENT BIOLOGY, 2015, 25 (02) :231-235
[7]   The Natural Statistics of Audiovisual Speech [J].
Chandrasekaran, Chandramouli ;
Trubanova, Andrea ;
Stillittano, Sebastien ;
Caplier, Alice ;
Ghazanfar, Asif A. .
PLOS COMPUTATIONAL BIOLOGY, 2009, 5 (07)
[8]   Eye Can Hear Clearly Now: Inverse Effectiveness in Natural Audiovisual Speech Processing Relies on Long-Term Crossmodal Temporal Integration [J].
Crosse, Michael J. ;
Di Liberto, Giovanni M. ;
Lalor, Edmund C. .
JOURNAL OF NEUROSCIENCE, 2016, 36 (38) :9888-9895
[9]   Perceptual training enhances temporal acuity for multisensory speech [J].
De Niear, Matthew A. ;
Gupta, Pranjal B. ;
Baum, Sarah H. ;
Wallace, Mark T. .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2018, 147 :9-17
[10]   EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis [J].
Delorme, A ;
Makeig, S .
JOURNAL OF NEUROSCIENCE METHODS, 2004, 134 (01) :9-21