Sound gaps boost emotional audiovisual integration independent of attention: Evidence from an ERP study

被引:7
作者
Liang, Junyu [1 ,3 ]
Li, Yuchen [1 ,3 ]
Zhang, Zhao [1 ,2 ,3 ]
Luo, Wenbo [1 ,3 ]
机构
[1] Liaoning Normal Univ, Res Ctr Brain & Cognit Neurosci, 850 Huanghe Rd, Dalian 116029, Peoples R China
[2] Weifang Med Univ, Inst Psychol, Weifang 216053, Peoples R China
[3] Key Lab Brain & Cognit Neurosci, Dalian 116029, Liaoning, Peoples R China
关键词
Audiovisual integration; Interrupted sound; Face emotion-decoding; Microstate analysis; FACIAL EXPRESSIONS; TIME-COURSE; ELECTROCORTICAL RESPONSES; FACES; PERCEPTION; TUTORIAL; PICTURES; SIGNALS; BINDING; CONTEXT;
D O I
10.1016/j.biopsycho.2021.108246
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The emotion discrimination paradigm was adopted to study the effect of interrupted sound on visual emotional processing under different attentional states. There were two experiments: Experiment 1: judging facial expressions (explicit task), Experiment 2: judging the position of a bar (implicit task). In Experiment 1, ERP results showed that there was a sound gap accelerating the effect of P1 present only under neutral faces. In Experiment 2, the accelerating effect (P1) existed regardless of the emotional condition. Combining two experiments, P1 findings suggest that sound gap enhances bottom-up attention. The N170 and late positive component (LPC) were found to be regulated by emotion face in both experiments, with fear over the neutral. Comparing the two experiments, the explicit task induced a larger LPC than the implicit task. Overall, sound gaps boosted the audiovisual integration by bottom-up attention in early integration, while cognitive expectations led to top-down attention in late stages.
引用
收藏
页数:12
相关论文
共 59 条
[1]   Spatial attention affects the early processing of neutral versus fearful faces when they are task-irrelevant: a classifier study of the EEG C1 component [J].
Acunzo, David ;
MacKenzie, Graham ;
van Rossum, Mark C. W. .
COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2019, 19 (01) :123-137
[2]   Modulation of Early Perceptual Processing by Emotional Expression and Acquired Valence of Faces An ERP Study [J].
Aguado, Luis ;
Valdes-Conroy, Berenice ;
Rodriguez, Sonia ;
Roman, Francisco J. ;
Dieguez-Risco, Teresa ;
Fernandez-Cahill, Maria .
JOURNAL OF PSYCHOPHYSIOLOGY, 2012, 26 (01) :29-41
[3]   Perceived arousal of facial expressions of emotion modulates the N170, regardless of emotional category: Time domain and time-frequency dynamics [J].
Almeida, Pedro R. ;
Ferreira-Santos, Fernando ;
Chaves, Pedro L. ;
Paiva, Tiago O. ;
Barbosa, Fernando ;
Marques-Teixeira, Joao .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2016, 99 :48-56
[4]   The role of multisensory interplay in enabling temporal expectations [J].
Ball, Felix ;
Michels, Lara E. ;
Thiele, Carsten ;
Noesselt, Toemme .
COGNITION, 2018, 170 :130-146
[5]   Electrophysiological studies of face perception in humans [J].
Bentin, S ;
Allison, T ;
Puce, A ;
Perez, E ;
McCarthy, G .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1996, 8 (06) :551-565
[6]   See What You Think: Reappraisal Modulates Behavioral and Neural Responses to Social Stimuli [J].
Blechert, Jens ;
Sheppes, Gal ;
Di Tella, Carolina ;
Williams, Hants ;
Gross, James J. .
PSYCHOLOGICAL SCIENCE, 2012, 23 (04) :346-353
[7]   Cross-modal Emotional Attention: Emotional Voices Modulate Early Stages of Visual Processing [J].
Brosch, Tobias ;
Grandjean, Didier ;
Sander, David ;
Scherer, Klaus R. .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2009, 21 (09) :1670-1679
[8]   Emotional voices in context: A neurobiological model of multimodal affective information processing [J].
Brueck, Carolin ;
Kreifelts, Benjamin ;
Wildgruber, Dirk .
PHYSICS OF LIFE REVIEWS, 2011, 8 (04) :383-403
[9]   Multisensory integration: methodological approaches and emerging principles in the human brain [J].
Calvert, GA ;
Thesen, T .
JOURNAL OF PHYSIOLOGY-PARIS, 2004, 98 (1-3) :191-205
[10]   Being First Matters: Topographical Representational Similarity Analysis of ERP Signals Reveals Separate Networks for Audiovisual Temporal Binding Depending on the Leading Sense [J].
Cecere, Roberto ;
Gross, Joachim ;
Willis, Ashleigh ;
Thut, Gregor .
JOURNAL OF NEUROSCIENCE, 2017, 37 (21) :5274-5287