Lexical influences in audiovisual speech perception

被引:51
作者
Brancazio, L
机构
[1] Haskins Labs Inc, New Haven, CT 06511 USA
[2] So Connecticut State Univ, Dept Psychol, New Haven, CT 06515 USA
关键词
D O I
10.1037/0096-1523.30.3.445
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Phoneme identification with audiovisually discrepant stimuli is influenced by information in the visual signal (the McGurk effect). Additionally, lexical status affects identification of auditorily presented phonemes. The present study tested for lexical influences on the McGurk effect. Participants identified phonemes in audiovisually discrepant stimuli in which lexical status of the auditory component and of a visually influenced percept was independently varied. Visually influenced (McGurk) responses were more frequent when they formed a word and when the auditory signal was a nonword (Experiment 1). Lexical effects were larger for slow than for fast responses (Experiment 2), as with auditory speech, and were replicated with stimuli matched on physical properties (Experiment 3). These results are consistent with models in which lexical processing of speech is modality independent.
引用
收藏
页码:445 / 463
页数:19
相关论文
共 69 条
[1]  
[Anonymous], HEARING EYE
[2]  
[Anonymous], [No title captured]
[3]   Speechreading and the structure of the lexicon: Computationally modeling the effects of reduced phonetic distinctiveness on lexical uniqueness [J].
Auer, ET ;
Bernstein, LE .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1997, 102 (06) :3704-3710
[4]  
BERNSTEIN LE, 1989, BEHAV BRAIN SCI, V12, P756, DOI 10.1017/S0140525X00025632
[5]   Merging auditory and visual phonetic information: A critical test for feedback? [J].
Brancazio, L ;
Fowler, CA .
BEHAVIORAL AND BRAIN SCIENCES, 2000, 23 (03) :327-+
[6]   LEXICAL EFFECTS ON PHONETIC CATEGORIZATION - THE ROLE OF STIMULUS NATURALNESS AND STIMULUS QUALITY [J].
BURTON, MW ;
BLUMSTEIN, SE .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1995, 21 (05) :1230-1235
[7]   LEXICAL EFFECTS ON THE PHONETIC CATEGORIZATION OF SPEECH - THE ROLE OF ACOUSTIC STRUCTURE [J].
BURTON, MW ;
BAUM, SR ;
BLUMSTEIN, SE .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1989, 15 (03) :567-575
[8]   PSYSCOPE - AN INTERACTIVE GRAPHIC SYSTEM FOR DESIGNING AND CONTROLLING EXPERIMENTS IN THE PSYCHOLOGY LABORATORY USING MACINTOSH COMPUTERS [J].
COHEN, J ;
MACWHINNEY, B ;
FLATT, M ;
PROVOST, J .
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 1993, 25 (02) :257-271
[9]   INTERACTIVE USE OF LEXICAL INFORMATION IN SPEECH-PERCEPTION [J].
CONNINE, CM ;
CLIFTON, C .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1987, 13 (02) :291-299
[10]   PHONEME IDENTIFICATION AND THE LEXICON [J].
CUTLER, A ;
MEHLER, J ;
NORRIS, D ;
SEGUI, J .
COGNITIVE PSYCHOLOGY, 1987, 19 (02) :141-177