Memory Load Alters Perception-Related Neural Oscillations during Multisensory Integration

被引:23
作者
Michail, Georgios [1 ]
Senkowski, Daniel [1 ]
Niedeggen, Michael [2 ]
Keil, Julian [3 ]
机构
[1] Charite Univ Med Berlin, Dept Psychiat & Psychotherapy, St Hedwig Hosp, D-10115 Berlin, Germany
[2] Free Univ Berlin, Dept Educ & Psychol, D-14195 Berlin, Germany
[3] Christian Albrechts Univ Kiel, Biol Psychol, D-24118 Kiel, Germany
关键词
beta oscillations; multisensory integration; sound-induced flash illusion; theta oscillations; top-down; working memory; FRONTAL THETA; TOP-DOWN; AUDIOVISUAL INTEGRATION; PREDICTION ERRORS; HEARING LIPS; ATTENTION; POWER; SYNCHRONY; DYNAMICS; CORTEX;
D O I
10.1523/JNEUROSCI.1397-20.2020
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Integrating information across different senses is a central feature of human perception. Previous research suggests that multisensory integration is shaped by a context-dependent and largely adaptive interplay between stimulus-driven bottom-up and top-down endogenous influences. One critical question concerns the extent to which this interplay is sensitive to the amount of available cognitive resources. In the present study, we investigated the influence of limited cognitive resources on audiovisual integration by measuring high-density electroencephalography (EEG) in healthy participants performing the soundinduced flash illusion (SIFI) and a verbal n-back task (0-back, low load and 2-back, high load) in a dual-task design. In the SIFI, the integration of a flash with two rapid beeps can induce the illusory perception of two flashes. We found that high compared with low load increased illusion susceptibility and modulated neural oscillations underlying illusion-related crossmodal interactions. Illusion perception under high load was associated with reduced early beta power (18-26 Hz, similar to 70 ms) in auditory and motor areas, presumably reflecting an early mismatch signal and subsequent top-down influences including increased frontal theta power (7-9 Hz, similar to 120 ms) in mid-anterior cingulate cortex (ACC) and a later beta power suppression (13-22 Hz, similar to 350 ms) in prefrontal and auditory cortex. Our study demonstrates that integrative crossmodal interactions underlying the SIFI are sensitive to the amount of available cognitive resources and that multisensory integration engages top-down theta and beta oscillations when cognitive resources are scarce.
引用
收藏
页码:1505 / 1515
页数:11
相关论文
共 73 条
[1]   Audiovisual integration of speech falters under high attention demands [J].
Alsius, A ;
Navarra, J ;
Campbell, R ;
Soto-Faraco, S .
CURRENT BIOLOGY, 2005, 15 (09) :839-843
[2]   Attention to touch weakens audiovisual speech integration [J].
Alsius, Agnes ;
Navarra, Jordi ;
Soto-Faraco, Salvador .
EXPERIMENTAL BRAIN RESEARCH, 2007, 183 (03) :399-404
[3]   Cortical oscillations and sensory predictions [J].
Arnal, Luc H. ;
Giraud, Anne-Lise .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (07) :390-398
[4]   Transitions in neural oscillations reflect prediction errors generated in audiovisual speech [J].
Arnal, Luc H. ;
Wyart, Valentin ;
Giraud, Anne-Lise .
NATURE NEUROSCIENCE, 2011, 14 (06) :797-U164
[5]   Beta/Gamma Oscillations and Event-Related Potentials Indicate Aberrant Multisensory Processing in Schizophrenia [J].
Balz, Johanna ;
Romero, Yadira Roa ;
Keil, Julian ;
Krebber, Martin ;
Niedeggen, Michael ;
Gallinat, Juergen ;
Senkowski, Daniel .
FRONTIERS IN PSYCHOLOGY, 2016, 7
[6]   GABA concentration in superior temporal sulcus predicts gamma power and perception in the sound-induced flash illusion [J].
Balz, Johanna ;
Keil, Julian ;
Romero, Yadira Roa ;
Mekle, Ralf ;
Schubert, Florian ;
Aydin, Semiha ;
Ittermann, Bernd ;
Gallinat, Juergen ;
Senkowski, Daniel .
NEUROIMAGE, 2016, 125 :724-730
[7]   Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels [J].
Bastos, Andre Moraes ;
Vezoli, Julien ;
Bosman, Conrado Arturo ;
Schoffelen, Jan-Mathijs ;
Oostenveld, Robert ;
Dowdall, Jarrod Robert ;
De Weerd, Peter ;
Kennedy, Henry ;
Fries, Pascal .
NEURON, 2015, 85 (02) :390-401
[8]   Integration of auditory and visual information about objects in superior temporal sulcus [J].
Beauchamp, MS ;
Lee, KE ;
Argall, BD ;
Martin, A .
NEURON, 2004, 41 (05) :809-823
[9]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[10]   Changes in brain network activity during working memory tasks: A magnetoencephalography study [J].
Brookes, Matthew J. ;
Wood, Jonathan R. ;
Stevenson, Claire M. ;
Zumer, Johanna M. ;
White, Thomas P. ;
Liddle, Peter F. ;
Morris, Peter G. .
NEUROIMAGE, 2011, 55 (04) :1804-1815