Rhythmicity and cross-modal temporal cues facilitate detection

被引:60
|
作者
ten Oever, Sanne [1 ]
Schroeder, Charles E. [2 ,3 ,4 ]
Poeppel, David [5 ]
van Atteveldt, Nienke [1 ,6 ,7 ]
Zion-Golumbic, Elana [2 ,3 ,4 ,8 ]
机构
[1] Maastricht Univ, Fac Psychol & Neurosci, NL-6200 MD Maastricht, Netherlands
[2] Columbia Univ, Med Ctr, Dept Psychiat, New York, NY 10032 USA
[3] Columbia Univ, Med Ctr, Dept Neurol, New York, NY 10032 USA
[4] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
[6] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, Amsterdam, Netherlands
[7] Vrije Univ Amsterdam, Inst Learn, Amsterdam, Netherlands
[8] Bar Ilan Univ, Gonda Brain Res Ctr, Ramat Gan, Israel
关键词
Temporal prediction; Audiovisual integration; Rhythmicity; Detection; LOW-FREQUENCY OSCILLATIONS; NEURONAL OSCILLATIONS; MULTISENSORY INTEGRATION; AUDITORY DETECTION; VISUAL SPEECH; ATTENTION; DYNAMICS; RECALIBRATION; ENTRAINMENT; COMBINATION;
D O I
10.1016/j.neuropsychologia.2014.08.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Temporal structure in the environment often has predictive value for anticipating the occurrence of forthcoming events. In this study we investigated the influence of two types of predictive temporal information on the perception of near-threshold auditory stimuli: 1) intrinsic temporal rhythmicity within an auditory stimulus stream and 2) temporally-predictive visual cues. We hypothesized that combining predictive temporal information within- and across-modality should decrease the threshold at which sounds are detected, beyond the advantage provided by each information source alone. Two experiments were conducted in which participants had to detect tones in noise. Tones were presented in either rhythmic or random sequences and were preceded by a temporally predictive visual signal in half of the trials. We show that detection intensities are lower for rhythmic (vs. random) and audiovisual (vs. auditory-only) presentation, independent from response bias, and that this effect is even greater for rhythmic audiovisual presentation. These results suggest that both types of temporal information are used to optimally process sounds that occur at expected points in time (resulting in enhanced detection), and that multiple temporal cues are combined to improve temporal estimates. Our findings underscore the flexibility and proactivity of the perceptual system which uses within- and across-modality temporal cues to anticipate upcoming events and process them optimally. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 50
页数:8
相关论文
共 50 条
  • [31] The Cross-modal Congruency Effect as an Objective Measure of Embodiment
    Verhagen, Pim
    Kuling, Irene
    Gijsbertse, Kaj
    Stuldreher, Ivo, V
    Overvliet, Krista
    Falcone, Sara
    Van Erp, Jan
    Brouwer, Anne-Marie
    COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 107 - 111
  • [32] Cross-modal attentional effects of rhythmic sensory stimulation
    Pomper, Ulrich
    Szaszko, Bence
    Pfister, Simon
    Ansorge, Ulrich
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2023, 85 (03) : 863 - 878
  • [33] Conscious access to the unisensory components of a cross-modal illusion
    Soto-Faraco, Salvador
    Alsius, Agnes
    NEUROREPORT, 2007, 18 (04) : 347 - 350
  • [34] The Impact of Cross-Modal Correspondences on Working Memory Performance
    Brunetti, Riccardo
    Indraccolo, Allegra
    Spence, Charles
    Mastroberardino, Serena
    Santangelo, Valerio
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2017, 43 (04) : 819 - 831
  • [35] Cross-modal attentional entrainment: Insights from magicians
    Anthony S. Barnhart
    Mandy J. Ehlert
    Stephen D. Goldinger
    Alison D. Mackey
    Attention, Perception, & Psychophysics, 2018, 80 : 1240 - 1249
  • [36] Tactile Cross-Modal Acceleration Effects on Auditory Steady-State Response
    Sugiyama, Shunsuke
    Kinukawa, Tomoaki
    Takeuchi, Nobuyuki
    Nishihara, Makoto
    Shioiri, Toshiki
    Inui, Koji
    FRONTIERS IN INTEGRATIVE NEUROSCIENCE, 2019, 13
  • [37] The unity assumption facilitates cross-modal binding of musical, non-speech stimuli: The role of spectral and amplitude envelope cues
    Chuen, Lorraine
    Schutz, Michael
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2016, 78 (05) : 1512 - 1528
  • [38] Cross-modal links in spatial attention
    Driver, J
    Spence, C
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 1998, 353 (1373) : 1319 - 1331
  • [39] Cross-modal binding and working memory
    Allen, Richard J.
    Hitch, Graham J.
    Baddeley, Alan D.
    VISUAL COGNITION, 2009, 17 (1-2) : 83 - 102
  • [40] Cross-Modal Binding in Developmental Dyslexia
    Jones, Manon W.
    Branigan, Holly P.
    Parra, Mario A.
    Logie, Robert H.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2013, 39 (06) : 1807 - 1822