Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception

被引:9
作者
Biau, Emmanuel [1 ,2 ]
Schultz, Benjamin G. [2 ]
Gunter, Thomas C. [3 ]
Kotz, Sonja A. [2 ,3 ]
机构
[1] Univ Liverpool, Dept Psychol, Liverpool L69 7ZA, Merseyside, England
[2] Univ Maastricht, Dept Neuropsychol & Psychopharmacol, Basic & Appl NeuroDynam Lab, NL-6200 MD Maastricht, Netherlands
[3] Max Planck Inst Human Cognit & Brain Sci, Dept Neuropsychol, D-04103 Leipzig, Germany
关键词
audio-visual asynchrony; delta oscillations; motor cortex; multisensory speech; prosody; CORTICAL OSCILLATIONS; NEURONAL OSCILLATIONS; THETA OSCILLATIONS; PHASE ENTRAINMENT; TEMPORAL CORTEX; AUDITORY SPEECH; VISUAL PROSODY; GESTURES; INTEGRATION; ACTIVATION;
D O I
10.1523/JNEUROSCI.2965-20.2022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
During multisensory speech perception, slow delta oscillations (similar to 1-3 Hz) in the listener's brain synchronize with the speech signal, likely engaging in speech signal decomposition. Notable fluctuations in the speech amplitude envelope, resounding speaker prosody, temporally align with articulatory and body gestures and both provide complementary sensations that temporally structure speech. Further, delta oscillations in the left motor cortex seem to align with speech and musical beats, suggesting their possible role in the temporal structuring of (quasi)-rhythmic stimulation. We extended the role of delta oscillations to audiovisual asynchrony detection as a test case of the temporal analysis of multisensory prosody fluctuations in speech. We recorded Electroencephalograph (EEG) responses in an audiovisual asynchrony detection task while participants watched videos of a speaker. We filtered the speech signal to remove verbal content and examined how visual and auditory prosodic fea- tures temporally (mis-)align. Results confirm (1) that participants accurately detected audiovisual asynchrony, and (2) increased delta power in the left motor cortex in response to audiovisual asynchrony. The difference of delta power between asyn- chronous and synchronous conditions predicted behavioral performance, and (3) decreased delta-beta coupling in the left motor cortex when listeners could not accurately map visual and auditory prosodies. Finally, both behavioral and neurophysiological evidence was altered when a speaker's face was degraded by a visual mask. Together, these findings suggest that motor delta oscillations support asynchrony detection of multisensory prosodic fluctuation in speech.
引用
收藏
页码:2313 / 2326
页数:14
相关论文
共 50 条
  • [21] Temporal limits on rubber hand illusion reflect individuals' temporal resolution in multisensory perception
    Costantini, Marcello
    Robinson, Jeffrey
    Migliorati, Daniele
    Donno, Brunella
    Ferri, Francesca
    Northoff, Georg
    COGNITION, 2016, 157 : 39 - 48
  • [22] Sustained neural rhythms reveal endogenous oscillations supporting speech perception
    van Bree, Sander
    Sohoglu, Ediz
    Davis, Matthew H.
    Zoefel, Benedikt
    PLOS BIOLOGY, 2021, 19 (02)
  • [23] A link between individual differences in multisensory speech perception and eye movements
    Gurler, Demet
    Doyle, Nathan
    Walker, Edgar
    Magnotti, John
    Beauchamp, Michael
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2015, 77 (04) : 1333 - 1341
  • [24] Dynamic causal modeling analysis reveals the modulation of motor cortex and integration in superior temporal gyrus during multisensory speech perception
    Zou, Ting
    Li, Liyuan
    Huang, Xinju
    Deng, Chijun
    Wang, Xuyang
    Gao, Qing
    Chen, Huafu
    Li, Rong
    COGNITIVE NEURODYNAMICS, 2024, 18 (03) : 795 - 811
  • [25] Asynchrony from synchrony: long-range gamma-band neural synchrony accompanies perception of audiovisual speech asynchrony
    Doesburg, Sam M.
    Emberson, Lauren L.
    Rahi, Alan
    Cameron, David
    Ward, Lawrence M.
    EXPERIMENTAL BRAIN RESEARCH, 2008, 185 (01) : 11 - 20
  • [26] Asynchrony from synchrony: long-range gamma-band neural synchrony accompanies perception of audiovisual speech asynchrony
    Sam M. Doesburg
    Lauren L. Emberson
    Alan Rahi
    David Cameron
    Lawrence M. Ward
    Experimental Brain Research, 2008, 185 : 11 - 20
  • [27] Neural correlates of multisensory enhancement in audiovisual narrative speech perception: A fMRI investigation
    Ross, Lars A.
    Molholm, Sophie
    Butler, John S.
    Del Bene, Victor A.
    Foxe, John J.
    NEUROIMAGE, 2022, 263
  • [28] Memory Load Alters Perception-Related Neural Oscillations during Multisensory Integration
    Michail, Georgios
    Senkowski, Daniel
    Niedeggen, Michael
    Keil, Julian
    JOURNAL OF NEUROSCIENCE, 2021, 41 (07) : 1505 - 1515
  • [29] Reanalyzing neurocognitive data on the role of the motor system in speech perception within COSMO, a Bayesian perceptuo-motor model of speech communication
    Barnaud, Marie-Lou
    Bessiere, Pierre
    Diard, Julien
    Schwartz, Jean-Luc
    BRAIN AND LANGUAGE, 2018, 187 : 19 - 32
  • [30] Recognizing speech in a novel accent: the motor theory of speech perception reframed
    Moulin-Frier, Clement
    Arbib, Michael A.
    BIOLOGICAL CYBERNETICS, 2013, 107 (04) : 421 - 447