Neural correlates of audiovisual integration of semantic category information

被引：15

作者：

Hu, Zhonghua ^{[2
]}

Zhang, Ruiling ^{[2
]}

Zhang, Qinglin ^{[2
]}

Liu, Qiang ^{[1
,2
]}

Li, Hong ^{[3
]}

机构：

[1] Southwest Univ, Dept Psychol, Key Lab Cognit & Personal, Minist Educ, Chongqing 400715, Peoples R China

[2] Southwest Univ, Sch Psychol, Chongqing 400715, Peoples R China

[3] Liaoning Normal Univ, Res Ctr Psychol Dev & Educ, Dalian 116029, Peoples R China

来源：

BRAIN AND LANGUAGE | 2012年 / 121卷 / 01期

基金：

中国国家自然科学基金;

关键词：

Audiovisual integration; Event-related potential (ERP); Semantic congruency; AUDITORY-VISUAL INTERACTIONS; ERROR-RELATED NEGATIVITY; SPEECH SOUNDS; MULTISENSORY INTERACTIONS; HUMAN BRAIN; PERCEPTION; CONFLICT; HUMANS; CORTICES;

D O I：

10.1016/j.bandl.2012.01.002

中图分类号：

R36 [病理学]; R76 [耳鼻咽喉科学];

学科分类号：

100104 ; 100213 ;

摘要：

Previous studies have found a late frontal-central audiovisual interaction during the time period about 150-220 ms post-stimulus. However, it is unclear to which process is this audiovisual interaction related: to processing of acoustical features or to classification of stimuli? To investigate this question, event-related potentials were recorded during a words-categorization task with stimuli presented in the auditory-visual modality. In the experiment, congruency of the visual and auditory stimuli was manipulated. Results showed that within the window of about 180-210 ms post-stimulus more positive values were elicited by category-congruent audiovisual stimuli than category-incongruent audiovisual stimuli. This indicates that the late frontal-central audiovisual interaction is related to audiovisual integration of semantic category information. (C) 2012 Elsevier Inc. All rights reserved.

引用

页码：70 / 75

页数：6

共 41 条

[31] Auditory-visual processing represented in the human superior temporal gyrus [J].

Reale, R. A. ;

Calvert, G. A. ;

Thesen, T. ;

Jenison, R. L. ;

Kawasaki, H. ;

Oya, H. ;

Howard, M. A. ;

Brugge, J. F. .

NEUROSCIENCE, 2007, 145 (01) :162-184

[32]

Sekiyama K., 2003, NEUROSCI RES, V25, P76

[33] Combined perception of emotion in pictures and musical sounds [J].

Spreckelmeyer, KN ;

Kutas, M ;

Urbach, TP ;

Altenmüller, E ;

Münte, TF .

BRAIN RESEARCH, 2006, 1070 (01) :160-170

[34] Neural correlates of multisensory integration of ecologically valid audiovisual events [J].

Stekelenburg, Jeroen J. ;

Vroomen, Jean .

JOURNAL OF COGNITIVE NEUROSCIENCE, 2007, 19 (12) :1964-1973

[35] The multifaceted interplay between attention and multisensory integration [J].

Talsma, Durk ;

Senkowski, Daniel ;

Soto-Faraco, Salvador ;

Woldorff, Marty G. .

TRENDS IN COGNITIVE SCIENCES, 2010, 14 (09) :400-410

[36] Effects of spatial congruity on audio-visual multimodal integration [J].

Teder-Sälejärvi, WA ;

Di Russo, F ;

McDonald, JJ ;

Hillyard, SA .

JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (09) :1396-1409

[37] Integration of letters and speech sounds in the human brain [J].

van Atteveldt, N ;

Formisano, E ;

Goebel, R ;

Blomert, L .

NEURON, 2004, 43 (02) :271-282

[38] The effect of temporal asynchrony on the multisensory integration of letters and speech sounds [J].

van Atteveldt, Nienke M. ;

Formisano, Elia ;

Blomert, Leo ;

Goebel, Rainer .

CEREBRAL CORTEX, 2007, 17 (04) :962-974

[39] Polysensory interactions along lateral temporal regions evoked by audiovisual speech [J].

Wright, TM ;

Pelphrey, KA ;

Allison, T ;

McKeown, MJ ;

McCarthy, G .

CEREBRAL CORTEX, 2003, 13 (10) :1034-1043

[40] The impact of cognitive deficits on conflict monitoring - Predictable dissociations between the error-related negativity and N2 [J].

Yeung, N ;

Cohen, JD .

PSYCHOLOGICAL SCIENCE, 2006, 17 (02) :164-171

← 1 2 3 4 5 →