The benefit of multisensory integration with biological motion signals

被引:14
作者
Mendonca, Catarina [1 ,2 ]
Santos, Jorge A. [2 ]
Lopez-Moliner, Joan [3 ]
机构
[1] Ctr Comp Graf, Lab Visualizat & Percept, P-4800058 Guimaraes, Portugal
[2] Univ Minho, Sch Psychol, Braga, Portugal
[3] Univ Barcelona, Grp Vis & Control Act, Inst Brain Cognit & Behav, Catalonia, Spain
关键词
Optimal integration; Biological motion; Velocity perception; Audiovisual integration; Point-light walkers; AUDITORY INFORMATION; TEMPORAL WINDOW; PERCEPTION; JUDGMENTS; SYNCHRONY;
D O I
10.1007/s00221-011-2620-4
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Assessing intentions, direction, and velocity of others is necessary for most daily tasks, and such information is often made available by both visual and auditory motion cues. Therefore, it is not surprising our great ability to perceive human motion. Here, we explore the multisensory integration of cues of biological motion walking speed. After testing for audiovisual asynchronies (visual signals led auditory ones by 30 ms in simultaneity temporal windows of 76.4 ms), in the main experiment, visual, auditory, and bimodal stimuli were compared to a standard audiovisual walker in a velocity discrimination task. Results in variance reduction conformed to optimal integration of congruent bimodal stimuli across all subjects. Interestingly, the perceptual judgements were still close to optimal for stimuli at the smallest level of incongruence. Comparison of slopes allows us to estimate an integration window of about 60 ms, which is smaller than that reported in audiovisual speech.
引用
收藏
页码:185 / 192
页数:8
相关论文
共 36 条
  • [1] The ventriloquist effect results from near-optimal bimodal integration
    Alais, D
    Burr, D
    [J]. CURRENT BIOLOGY, 2004, 14 (03) : 257 - 262
  • [2] Synchronizing to real events: Subjective audiovisual alignment scales with perceived auditory depth and speed of sound
    Alais, D
    Carlile, S
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (06) : 2244 - 2247
  • [3] ALAIS D, 2004, COG BRAIN RES, V19, P195
  • [4] Maximum Likelihood Integration of rapid flashes and beeps
    Andersen, TS
    Tiippana, K
    Sams, M
    [J]. NEUROSCIENCE LETTERS, 2005, 380 (1-2) : 155 - 160
  • [5] [Anonymous], 1993, An introduction to the bootstrap
  • [6] Perceptual synchrony of audiovisual streams for natural and artificial motion sequences
    Arrighi, Roberto
    Alais, David
    Burr, David
    [J]. JOURNAL OF VISION, 2006, 6 (03): : 260 - 268
  • [7] Meaningful auditory information enhances perception of visual biological motion
    Arrighi, Roberto
    Marini, Francesco
    Burr, David
    [J]. JOURNAL OF VISION, 2009, 9 (04):
  • [8] Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions
    Barraclough, NE
    Xiao, DK
    Baker, CI
    Oram, MW
    Perrett, DI
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (03) : 377 - 391
  • [9] Bayesian integration of visual and auditory signals for spatial localization
    Battaglia, PW
    Jacobs, RA
    Aslin, RN
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2003, 20 (07): : 1391 - 1397
  • [10] Discriminating audiovisual speed: Optimal integration of speed defaults to probability summation when component reliabilities diverge
    Bentvelzen, Adam
    Leung, Johahn
    Alais, David
    [J]. PERCEPTION, 2009, 38 (07) : 966 - 987