Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception

被引:9
|
作者
Biau, Emmanuel [1 ,2 ]
Schultz, Benjamin G. [2 ]
Gunter, Thomas C. [3 ]
Kotz, Sonja A. [2 ,3 ]
机构
[1] Univ Liverpool, Dept Psychol, Liverpool L69 7ZA, Merseyside, England
[2] Univ Maastricht, Dept Neuropsychol & Psychopharmacol, Basic & Appl NeuroDynam Lab, NL-6200 MD Maastricht, Netherlands
[3] Max Planck Inst Human Cognit & Brain Sci, Dept Neuropsychol, D-04103 Leipzig, Germany
来源
JOURNAL OF NEUROSCIENCE | 2022年 / 42卷 / 11期
关键词
audio-visual asynchrony; delta oscillations; motor cortex; multisensory speech; prosody; CORTICAL OSCILLATIONS; NEURONAL OSCILLATIONS; THETA OSCILLATIONS; PHASE ENTRAINMENT; TEMPORAL CORTEX; AUDITORY SPEECH; VISUAL PROSODY; GESTURES; INTEGRATION; ACTIVATION;
D O I
10.1523/JNEUROSCI.2965-20.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
During multisensory speech perception, slow delta oscillations (similar to 1-3 Hz) in the listener's brain synchronize with the speech signal, likely engaging in speech signal decomposition. Notable fluctuations in the speech amplitude envelope, resounding speaker prosody, temporally align with articulatory and body gestures and both provide complementary sensations that temporally structure speech. Further, delta oscillations in the left motor cortex seem to align with speech and musical beats, suggesting their possible role in the temporal structuring of (quasi)-rhythmic stimulation. We extended the role of delta oscillations to audiovisual asynchrony detection as a test case of the temporal analysis of multisensory prosody fluctuations in speech. We recorded Electroencephalograph (EEG) responses in an audiovisual asynchrony detection task while participants watched videos of a speaker. We filtered the speech signal to remove verbal content and examined how visual and auditory prosodic fea- tures temporally (mis-)align. Results confirm (1) that participants accurately detected audiovisual asynchrony, and (2) increased delta power in the left motor cortex in response to audiovisual asynchrony. The difference of delta power between asyn- chronous and synchronous conditions predicted behavioral performance, and (3) decreased delta-beta coupling in the left motor cortex when listeners could not accurately map visual and auditory prosodies. Finally, both behavioral and neurophysiological evidence was altered when a speaker's face was degraded by a visual mask. Together, these findings suggest that motor delta oscillations support asynchrony detection of multisensory prosodic fluctuation in speech.
引用
收藏
页码:2313 / 2326
页数:14
相关论文
共 50 条
  • [11] Motor Circuit and Superior Temporal Sulcus Activities Linked to Individual Differences in Multisensory Speech Perception
    Liyuan Li
    Rong Li
    Xinju Huang
    Fei Shen
    Hongyu Wang
    Xuyang Wang
    Chijun Deng
    Chong Wang
    Jiale Yang
    Leiyao Zhang
    Jiyi Li
    Ting Zou
    Huafu Chen
    Brain Topography, 2021, 34 : 779 - 792
  • [12] Sensorimotor Oscillations Prior to Speech Onset Reflect Altered Motor Networks in Adults Who Stutter
    Mersov, Anna-Maria
    Jobst, Cecilia
    Cheyne, Douglas O.
    De Nil, Luc
    FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
  • [13] The Motor Network Reduces Multisensory Illusory Perception
    Murakami, Takenobu
    Abe, Mitsunari
    Wiratman, Winnugroho
    Fujiwara, Juri
    Okamoto, Masahiro
    Mizuochi-Endo, Tomomi
    Iwabuchi, Ttoshild
    Makuuchi, Michiru
    Yamashita, Akira
    Tiksnadi, Amanda
    Chang, Fang-Yu
    Kubo, Hitoshi
    Matsuda, Nozomu
    Kobayashi, Shunsuke
    Eifuku, Satoshi
    Ugawa, Yoshikazu
    JOURNAL OF NEUROSCIENCE, 2018, 38 (45): : 9679 - 9688
  • [14] Multisensory Speech Perception in Children with Autism Spectrum Disorders
    Woynaroski, Tiffany G.
    Kwakye, Leslie D.
    Foss-Feig, Jennifer H.
    Stevenson, Ryan A.
    Stone, Wendy L.
    Wallace, Mark T.
    JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS, 2013, 43 (12) : 2891 - 2902
  • [15] The cascading influence of multisensory processing on speech perception in autism
    Stevenson, Ryan A.
    Segers, Magali
    Ncube, Busisiwe L.
    Black, Karen R.
    Bebko, James M.
    Ferber, Susanne
    Barense, Morgan D.
    AUTISM, 2018, 22 (05) : 609 - 624
  • [16] Multisensory Speech Perception in Children with Autism Spectrum Disorders
    Tiffany G. Woynaroski
    Leslie D. Kwakye
    Jennifer H. Foss-Feig
    Ryan A. Stevenson
    Wendy L. Stone
    Mark T. Wallace
    Journal of Autism and Developmental Disorders, 2013, 43 : 2891 - 2902
  • [17] Audiovisual asynchrony detection and speech perception in hearing-impaired listeners with cochlear implants: A preliminary analysis
    Hay-McCutcheon, Marcia J.
    Pisoni, David B.
    Hunt, Kristopher K.
    INTERNATIONAL JOURNAL OF AUDIOLOGY, 2009, 48 (06) : 321 - 333
  • [18] The Motor Somatotopy of Speech Perception
    D'Ausillo, Alessandro
    Pulvermueller, Friedemann
    Saimas, Paola
    Bufalari, Ilaria
    Begliomini, Chiara
    Fadiga, Luciano
    CURRENT BIOLOGY, 2009, 19 (05) : 381 - 385
  • [19] The development of multisensory speech perception continues into the late childhood years
    Ross, Lars A.
    Molholm, Sophie
    Blanco, Daniella
    Gomez-Ramirez, Manuel
    Saint-Amour, Dave
    Foxe, John J.
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2011, 33 (12) : 2329 - 2337
  • [20] Electrophysiological evidence for a multisensory speech-specific mode of perception
    Stekelenburg, Jeroen J.
    Vroomen, Jean
    NEUROPSYCHOLOGIA, 2012, 50 (07) : 1425 - 1431