Neural oscillations reflect the individual differences in the temporal perception of audiovisual speech

被引:0
作者
Jiang, Zeliang [1 ]
An, Xingwei [1 ]
Liu, Shuang [1 ]
Yin, Erwei [1 ,2 ,3 ]
Yan, Ye [1 ,2 ,3 ]
Ming, Dong [1 ]
机构
[1] Tianjin Univ, Acad Med Engn & Translat Med, Tianjin 300072, Peoples R China
[2] Acad Mil Sci AMS, Def Innovat Inst, Beijing 100071, Peoples R China
[3] Tianjin Artificial Intelligence Innovat Ctr TAIIC, Tianjin 300457, Peoples R China
基金
中国国家自然科学基金;
关键词
audiovisual speech; electroencephalography (EEG); individual difference; neural oscillations; temporal perception; ALPHA OSCILLATIONS; BINDING WINDOW; INTEGRATION; EEG; RENORMALIZATION; ATTENTION; DYNAMICS;
D O I
10.1093/cercor/bhad304
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Multisensory integration occurs within a limited time interval between multimodal stimuli. Multisensory temporal perception varies widely among individuals and involves perceptual synchrony and temporal sensitivity processes. Previous studies explored the neural mechanisms of individual differences for beep-flash stimuli, whereas there was no study for speech. In this study, 28 subjects (16 male) performed an audiovisual speech/ba/simultaneity judgment task while recording their electroencephalography. We examined the relationship between prestimulus neural oscillations (i.e. the pre-pronunciation movement-related oscillations) and temporal perception. The perceptual synchrony was quantified using the Point of Subjective Simultaneity and temporal sensitivity using the Temporal Binding Window. Our results revealed dissociated neural mechanisms for individual differences in Temporal Binding Window and Point of Subjective Simultaneity. The frontocentral delta power, reflecting top-down attention control, is positively related to the magnitude of individual auditory leading Temporal Binding Windows (auditory Temporal Binding Windows; LTBWs), whereas the parieto-occipital theta power, indexing bottom-up visual temporal attention specific to speech, is negatively associated with the magnitude of individual visual leading Temporal Binding Windows (visual Temporal Binding Windows; RTBWs). In addition, increased left frontal and bilateral temporoparietal occipital alpha power, reflecting general attentional states, is associated with increased Points of Subjective Simultaneity. Strengthening attention abilities might improve the audiovisual temporal perception of speech and further impact speech integration.
引用
收藏
页码:10575 / 10583
页数:9
相关论文
共 72 条
[41]   Frontal cortex selects representations of the talker's mouth to aid in speech perception [J].
Ozker, Muge ;
Yoshor, Daniel ;
Beauchamp, Michael S. .
ELIFE, 2018, 7
[42]   Lip movements entrain the observers' low-frequency brain oscillations to facilitate speech intelligibility [J].
Park, Hyojin ;
Kayser, Christop ;
Thut, Gregor ;
Gross, Joachim .
ELIFE, 2016, 5
[43]   Frontal Top-Down Signals Increase Coupling of Auditory Low-Frequency Oscillations to Continuous Speech in Human Listeners [J].
Park, Hyojin ;
Ince, Robin A. A. ;
Schyns, Philippe G. ;
Thut, Gregor ;
Gross, Joachim .
CURRENT BIOLOGY, 2015, 25 (12) :1649-1653
[44]   Prediction and constraint in audiovisual speech perception [J].
Peelle, Jonathan E. ;
Sommers, Mitchell S. .
CORTEX, 2015, 68 :169-181
[45]   Neural Entrainment to Speech Modulates Speech Intelligibility [J].
Riecke, Lars ;
Formisano, Elia ;
Sorger, Bettina ;
Baskent, Deniz ;
Gaudrain, Etienne .
CURRENT BIOLOGY, 2018, 28 (02) :161-+
[46]   Brain Networks and ∝-Oscillations: Structural and Functional Foundations of Cognitive Control [J].
Sadaghiani, Sepideh ;
Kleinschmidt, Andreas .
TRENDS IN COGNITIVE SCIENCES, 2016, 20 (11) :805-817
[47]  
Sarko D.K., 2012, The Neural Bases of Multisensory Processes
[48]   The timing of visual speech modulates auditory neural processing [J].
Sato, Marc .
BRAIN AND LANGUAGE, 2022, 235
[49]   Neuronal oscillations and visual amplification of speech [J].
Schroeder, Charles E. ;
Lakatos, Peter ;
Kajikawa, Yoshinao ;
Partan, Sarah ;
Puce, Aina .
TRENDS IN COGNITIVE SCIENCES, 2008, 12 (03) :106-113
[50]   No, There Is No 150 ms Lead of Visual Speech on Auditory Speech, but a Range of Audiovisual Asynchronies Varying from Small Audio Lead to Large Audio Lag [J].
Schwartz, Jean-Luc ;
Savariaux, Christophe .
PLOS COMPUTATIONAL BIOLOGY, 2014, 10 (07)