Auditory-visual speech perception and synchrony detection for speech and nonspeech signals

被引:118
作者
Conrey, B [1 ]
Pisoni, DB [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
关键词
D O I
10.1121/1.2195091
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Previous research has identified a "synchrony window" of several hundred milliseconds over which auditory-visual (AV) asynchronies are not reliably perceived. Individual variability in the size of this AV synchrony window has been linked with variability in AV speech perception measures, but it was not clear whether AV speech perception measures are related to synchrony detection for speech only or for both speech and nonspeech signals. An experiment was conducted to investigate the relationship between measures of AV speech perception and AV synchrony detection for speech and nonspeech signals. Variability in AV synchrony detection for both speech and nonspeech signals was found to be related to variability in measures of auditory-only (A-only) and AV speech perception, suggesting that temporal processing for both speech and nonspeech signals must be taken into account in explaining variability in A-only and multisensory speech perception. (c) 2006 Acoustical Society of America.
引用
收藏
页码:4065 / 4073
页数:9
相关论文
共 27 条
[1]  
[Anonymous], 1985, RC110 CIT U NEW YORK
[2]   Neural correlates of auditory-visual stimulus onset asynchrony detection [J].
Bushara, KO ;
Grafman, J ;
Hallett, M .
JOURNAL OF NEUROSCIENCE, 2001, 21 (01) :300-304
[3]   PSYSCOPE - AN INTERACTIVE GRAPHIC SYSTEM FOR DESIGNING AND CONTROLLING EXPERIMENTS IN THE PSYCHOLOGY LABORATORY USING MACINTOSH COMPUTERS [J].
COHEN, J ;
MACWHINNEY, B ;
FLATT, M ;
PROVOST, J .
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 1993, 25 (02) :257-271
[4]  
CONREY B, 2003, P ISCA 2003 INT C AU
[5]   THE DETECTION OF AUDITORY VISUAL DESYNCHRONY [J].
DIXON, NF ;
SPITZ, L .
PERCEPTION, 1980, 9 (06) :719-721
[6]   Recalibration of audiovisual simultaneity [J].
Fujisaki, W ;
Shimojo, S ;
Kashino, M ;
Nishida, S .
NATURE NEUROSCIENCE, 2004, 7 (07) :773-778
[7]  
Grant K. W., 2001, ISCA INT C AUD VIS S
[8]   Measures of auditory-visual integration in nonsense syllables and sentences [J].
Grant, KW ;
Seitz, PF .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1998, 104 (04) :2438-2450
[9]  
GRANT KW, 2003, ISCA 2003 INT C AUD
[10]  
KING AJ, 1985, EXP BRAIN RES, V60, P492