Spatial-temporal dynamics of gesture-speech integration: a simultaneous EEG-fMRI study

被引：26

作者：

He, Yifei ^{[1
]}

Steines, Miriam ^{[1
]}

Sommer, Jens ^{[2
]}

Gebhardt, Helge ^{[4
]}

Nagels, Arne ^{[3
]}

Sammer, Gebhard ^{[4
]}

Kircher, Tilo ^{[2
]}

Straube, Benjamin ^{[1
]}

机构：

[1] Philipps Univ Marburg, MCMBB, Dept Psychiat & Psychotherapy, Translat Neuroimaging Lab, Rudolf Bultmann Str 8, D-35039 Marburg, Germany

[2] Philipps Univ Marburg, MCMBB, Dept Psychiat & Psychotherapy, Rudolf Bultmann Str 8, D-35039 Marburg, Germany

[3] Johannes Gutenberg Univ Mainz, Dept Gen Linguist, Jakob Welder Weg 18, D-55128 Mainz, Germany

[4] Justus Liebig Univ Giessen, Ctr Psychiat, Cognit Neurosci, Steg 28, D-35385 Giessen, Germany

来源：

BRAIN STRUCTURE & FUNCTION | 2018年 / 223卷 / 07期

关键词：

Simultaneous EEG-fMRI; Gesture; Language; Alpha oscillations; Multisensory integration; INTRINSIC CONNECTIVITY NETWORKS; ALPHA-BAND; MULTISENSORY INTEGRATION; NEURAL INTEGRATION; NEURONAL OSCILLATIONS; SEMANTIC INFORMATION; VISUAL INFORMATION; CROSSMODAL BINDING; BETA OSCILLATIONS; FUNCTIONAL MRI;

D O I：

10.1007/s00429-018-1674-5

中图分类号：

R602 [外科病理学、解剖学]; R32 [人体形态学];

学科分类号：

100101 ;

摘要：

The semantic integration between gesture and speech (GSI) is mediated by the left posterior temporal sulcus/middle temporal gyrus (pSTS/MTG) and the left inferior frontal gyrus (IFG). Evidence from electroencephalography (EEG) suggests that oscillations in the alpha and beta bands may support processes at different stages of GSI. In the present study, we investigated the relationship between electrophysiological oscillations and blood-oxygen-level-dependent (BOLD) activity during GSI. In a simultaneous EEG-fMRI study, German participants (n=19) were presented with videos of an actor either performing meaningful gestures in the context of a comprehensible German (GG) or incomprehensible Russian sentence (GR), or just speaking a German sentence (SG). EEG results revealed reduced alpha and beta power for the GG vs. SG conditions, while fMRI analyses showed BOLD increase in the left pSTS/MTG for GG>GRGG>SG. In time-window-based EEG-informed fMRI analyses, we further found a positive correlation between single-trial alpha power and BOLD signal in the left pSTS/MTG, the left IFG, and several sub-cortical regions. Moreover, the alpha-pSTS/MTG correlation was observed in an earlier time window in comparison to the alpha-IFG correlation, thus supporting a two-stage processing model of GSI. Our study shows that EEG-informed fMRI implies multiple roles of alpha oscillations during GSI, and that the method is a best candidate for multidimensional investigations on complex cognitive functions such as GSI.

引用

页码：3073 / 3089

页数：17

共 83 条

[1] Identification of EEG events in the MR scanner: The problem of pulse artifact and a method for its subtraction [J].