Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception

被引:9
|
作者
Biau, Emmanuel [1 ,2 ]
Schultz, Benjamin G. [2 ]
Gunter, Thomas C. [3 ]
Kotz, Sonja A. [2 ,3 ]
机构
[1] Univ Liverpool, Dept Psychol, Liverpool L69 7ZA, Merseyside, England
[2] Univ Maastricht, Dept Neuropsychol & Psychopharmacol, Basic & Appl NeuroDynam Lab, NL-6200 MD Maastricht, Netherlands
[3] Max Planck Inst Human Cognit & Brain Sci, Dept Neuropsychol, D-04103 Leipzig, Germany
来源
JOURNAL OF NEUROSCIENCE | 2022年 / 42卷 / 11期
关键词
audio-visual asynchrony; delta oscillations; motor cortex; multisensory speech; prosody; CORTICAL OSCILLATIONS; NEURONAL OSCILLATIONS; THETA OSCILLATIONS; PHASE ENTRAINMENT; TEMPORAL CORTEX; AUDITORY SPEECH; VISUAL PROSODY; GESTURES; INTEGRATION; ACTIVATION;
D O I
10.1523/JNEUROSCI.2965-20.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
During multisensory speech perception, slow delta oscillations (similar to 1-3 Hz) in the listener's brain synchronize with the speech signal, likely engaging in speech signal decomposition. Notable fluctuations in the speech amplitude envelope, resounding speaker prosody, temporally align with articulatory and body gestures and both provide complementary sensations that temporally structure speech. Further, delta oscillations in the left motor cortex seem to align with speech and musical beats, suggesting their possible role in the temporal structuring of (quasi)-rhythmic stimulation. We extended the role of delta oscillations to audiovisual asynchrony detection as a test case of the temporal analysis of multisensory prosody fluctuations in speech. We recorded Electroencephalograph (EEG) responses in an audiovisual asynchrony detection task while participants watched videos of a speaker. We filtered the speech signal to remove verbal content and examined how visual and auditory prosodic fea- tures temporally (mis-)align. Results confirm (1) that participants accurately detected audiovisual asynchrony, and (2) increased delta power in the left motor cortex in response to audiovisual asynchrony. The difference of delta power between asyn- chronous and synchronous conditions predicted behavioral performance, and (3) decreased delta-beta coupling in the left motor cortex when listeners could not accurately map visual and auditory prosodies. Finally, both behavioral and neurophysiological evidence was altered when a speaker's face was degraded by a visual mask. Together, these findings suggest that motor delta oscillations support asynchrony detection of multisensory prosodic fluctuation in speech.
引用
收藏
页码:2313 / 2326
页数:14
相关论文
共 50 条
  • [1] Multisensory speech perception without the left superior temporal sulcus
    Baum, Sarah H.
    Martin, Randi C.
    Hamilton, A. Cris
    Beauchamp, Michael S.
    NEUROIMAGE, 2012, 62 (03) : 1825 - 1832
  • [2] Neural oscillations reflect the individual differences in the temporal perception of audiovisual speech
    Jiang, Zeliang
    An, Xingwei
    Liu, Shuang
    Yin, Erwei
    Yan, Ye
    Ming, Dong
    CEREBRAL CORTEX, 2023, 33 (20) : 10575 - 10583
  • [3] The effect of temporal asynchrony on the multisensory integration of letters and speech sounds
    van Atteveldt, Nienke M.
    Formisano, Elia
    Blomert, Leo
    Goebel, Rainer
    CEREBRAL CORTEX, 2007, 17 (04) : 962 - 974
  • [4] Multisensory and sensorimotor interactions in speech perception
    Tiippana, Kaisa
    Moettoenen, Riikka
    Schwartz, Jean-Luc
    FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [5] Editorial: Multisensory speech in perception and production
    Sanchez, Kauyumari
    Neergaard, Karl David
    Dias, James W.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2024, 18
  • [6] Multisensory and lexical information in speech perception
    Dorsi, Josh
    Lacey, Simon
    Sathian, K.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2024, 17
  • [7] Are alpha oscillations instrumental in multisensory synchrony perception?
    Bastiaansen, Marcel
    Berberyan, Hermine
    Stekelenburg, Jeroen J.
    Schoffelen, Jan Mathijs
    Vroomen, Jean
    BRAIN RESEARCH, 2020, 1734
  • [8] Cascading and Multisensory Influences on Speech Perception Development
    Choi, Dawoon
    Black, Alexis K.
    Werker, Janet F.
    MIND BRAIN AND EDUCATION, 2018, 12 (04) : 212 - 223
  • [9] Motor Circuit and Superior Temporal Sulcus Activities Linked to Individual Differences in Multisensory Speech Perception
    Li, Liyuan
    Li, Rong
    Huang, Xinju
    Shen, Fei
    Wang, Hongyu
    Wang, Xuyang
    Deng, Chijun
    Wang, Chong
    Yang, Jiale
    Zhang, Leiyao
    Li, Jiyi
    Zou, Ting
    Chen, Huafu
    BRAIN TOPOGRAPHY, 2021, 34 (06) : 779 - 792
  • [10] Audiovisual Asynchrony Detection in Human Speech
    Maier, Joost X.
    Di Luca, Massimiliano
    Noppeney, Uta
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2011, 37 (01) : 245 - 256