Neural correlates of audiovisual integration of semantic category information

被引:15
作者
Hu, Zhonghua [2 ]
Zhang, Ruiling [2 ]
Zhang, Qinglin [2 ]
Liu, Qiang [1 ,2 ]
Li, Hong [3 ]
机构
[1] Southwest Univ, Dept Psychol, Key Lab Cognit & Personal, Minist Educ, Chongqing 400715, Peoples R China
[2] Southwest Univ, Sch Psychol, Chongqing 400715, Peoples R China
[3] Liaoning Normal Univ, Res Ctr Psychol Dev & Educ, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
Audiovisual integration; Event-related potential (ERP); Semantic congruency; AUDITORY-VISUAL INTERACTIONS; ERROR-RELATED NEGATIVITY; SPEECH SOUNDS; MULTISENSORY INTERACTIONS; HUMAN BRAIN; PERCEPTION; CONFLICT; HUMANS; CORTICES;
D O I
10.1016/j.bandl.2012.01.002
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Previous studies have found a late frontal-central audiovisual interaction during the time period about 150-220 ms post-stimulus. However, it is unclear to which process is this audiovisual interaction related: to processing of acoustical features or to classification of stimuli? To investigate this question, event-related potentials were recorded during a words-categorization task with stimuli presented in the auditory-visual modality. In the experiment, congruency of the visual and auditory stimuli was manipulated. Results showed that within the window of about 180-210 ms post-stimulus more positive values were elicited by category-congruent audiovisual stimuli than category-incongruent audiovisual stimuli. This indicates that the late frontal-central audiovisual interaction is related to audiovisual integration of semantic category information. (C) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:70 / 75
页数:6
相关论文
共 41 条
[21]   Semantic congruence is a critical factor in multisensory behavioral performance [J].
Laurienti, PJ ;
Kraft, RA ;
Maldjian, JA ;
Burdette, JH ;
Wallace, MT .
EXPERIMENTAL BRAIN RESEARCH, 2004, 158 (04) :405-414
[22]   The effect of visual reliability on auditory-visual integration: an event-related potential study [J].
Liu, Qiang ;
Qiu, Jiang ;
Chen, Antao ;
Yang, Juan ;
Zhang, Qinglin ;
Sun, Hong-Jin .
NEUROREPORT, 2007, 18 (17) :1861-1865
[23]   Neural mechanisms for the effect of prior knowledge on audiovisual integration [J].
Liu, Qiang ;
Zhang, Ye ;
Campos, Jennifer L. ;
Zhang, Qinglin ;
Sun, Hong-Jin .
BIOLOGICAL PSYCHOLOGY, 2011, 87 (02) :200-208
[24]   Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study [J].
Molholm, S ;
Ritter, W ;
Murray, MM ;
Javitt, DC ;
Schroeder, CE ;
Foxe, JJ .
COGNITIVE BRAIN RESEARCH, 2002, 14 (01) :115-128
[25]   Plasticity in representations of environmental sounds revealed by electrical neuroimaging [J].
Murray, Micah M. ;
Camen, Christian ;
Spierer, Lucas ;
Clarke, Stephanie .
NEUROIMAGE, 2008, 39 (02) :847-856
[26]   Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment [J].
Murray, MM ;
Molholm, S ;
Michel, CM ;
Heslenfeld, DJ ;
Ritter, W ;
Javitt, DC ;
Schroeder, CE ;
Foxe, JJ .
CEREBRAL CORTEX, 2005, 15 (07) :963-974
[27]   Electrophysiological correlates of anterior cingulate function in a go/no-go task: Effects of response conflict and trial type frequency [J].
Nieuwenhuis, Sander ;
Yeung, Nick ;
van den Wildenberg, Wery ;
Ridderinkhof, K. Richard .
COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2003, 3 (01) :17-26
[28]   A functional-anatomical model for lipreading [J].
Paulesu, E ;
Perani, D ;
Blasi, V ;
Silani, G ;
Borghese, NA ;
De Giovanni, U ;
Sensolo, S ;
Fazio, F .
JOURNAL OF NEUROPHYSIOLOGY, 2003, 90 (03) :2005-2013
[29]   Updating p300: An integrative theory of P3a and P3b [J].
Polich, John .
CLINICAL NEUROPHYSIOLOGY, 2007, 118 (10) :2128-2148
[30]   Audiovisual integration of letters in the human brain [J].
Raij, T ;
Uutela, K ;
Hari, R .
NEURON, 2000, 28 (02) :617-625