Rhythmicity and cross-modal temporal cues facilitate detection

被引:60
|
作者
ten Oever, Sanne [1 ]
Schroeder, Charles E. [2 ,3 ,4 ]
Poeppel, David [5 ]
van Atteveldt, Nienke [1 ,6 ,7 ]
Zion-Golumbic, Elana [2 ,3 ,4 ,8 ]
机构
[1] Maastricht Univ, Fac Psychol & Neurosci, NL-6200 MD Maastricht, Netherlands
[2] Columbia Univ, Med Ctr, Dept Psychiat, New York, NY 10032 USA
[3] Columbia Univ, Med Ctr, Dept Neurol, New York, NY 10032 USA
[4] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
[6] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, Amsterdam, Netherlands
[7] Vrije Univ Amsterdam, Inst Learn, Amsterdam, Netherlands
[8] Bar Ilan Univ, Gonda Brain Res Ctr, Ramat Gan, Israel
关键词
Temporal prediction; Audiovisual integration; Rhythmicity; Detection; LOW-FREQUENCY OSCILLATIONS; NEURONAL OSCILLATIONS; MULTISENSORY INTEGRATION; AUDITORY DETECTION; VISUAL SPEECH; ATTENTION; DYNAMICS; RECALIBRATION; ENTRAINMENT; COMBINATION;
D O I
10.1016/j.neuropsychologia.2014.08.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Temporal structure in the environment often has predictive value for anticipating the occurrence of forthcoming events. In this study we investigated the influence of two types of predictive temporal information on the perception of near-threshold auditory stimuli: 1) intrinsic temporal rhythmicity within an auditory stimulus stream and 2) temporally-predictive visual cues. We hypothesized that combining predictive temporal information within- and across-modality should decrease the threshold at which sounds are detected, beyond the advantage provided by each information source alone. Two experiments were conducted in which participants had to detect tones in noise. Tones were presented in either rhythmic or random sequences and were preceded by a temporally predictive visual signal in half of the trials. We show that detection intensities are lower for rhythmic (vs. random) and audiovisual (vs. auditory-only) presentation, independent from response bias, and that this effect is even greater for rhythmic audiovisual presentation. These results suggest that both types of temporal information are used to optimally process sounds that occur at expected points in time (resulting in enhanced detection), and that multiple temporal cues are combined to improve temporal estimates. Our findings underscore the flexibility and proactivity of the perceptual system which uses within- and across-modality temporal cues to anticipate upcoming events and process them optimally. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 50
页数:8
相关论文
共 50 条
  • [41] Temporal gap between visual and auditory stimuli lessen audiovisual integration in aging under cross-modal attention
    Ren, Yan-Na
    Yang, Weiping
    Takahashi, Satoshi
    Nakahashi, Kohei
    Wu, Jinglong
    2015 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2015, : 511 - 516
  • [42] Attentive Cross-Modal Paratope Prediction
    Deac, Andreea
    Velickovic, Petar
    Sormanni, Pietro
    JOURNAL OF COMPUTATIONAL BIOLOGY, 2019, 26 (06) : 536 - 545
  • [43] Visual determinants of a cross-modal illusion
    Armontrout, James A.
    Schutz, Michael
    Kubovy, Michael
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2009, 71 (07) : 1618 - 1627
  • [44] Cross-Modal Effects in Speech Perception
    Keough, Megan
    Derrick, Donald
    Gick, Bryan
    ANNUAL REVIEW OF LINGUISTICS, VOL 5, 2019, 5 : 49 - 66
  • [45] CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection
    Pang, Youwei
    Zhao, Xiaoqi
    Zhang, Lihe
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 892 - 904
  • [46] Spatial receptive field shift by preceding cross-modal stimulation in the cat superior colliculus
    Xu, Jinghong
    Bi, Tingting
    Wu, Jing
    Meng, Fanzhu
    Wang, Kun
    Hu, Jiawei
    Han, Xiao
    Zhang, Jiping
    Zhou, Xiaoming
    Keniston, Les
    Yu, Liping
    JOURNAL OF PHYSIOLOGY-LONDON, 2018, 596 (20): : 5033 - 5050
  • [47] Cross-Modal Interactions Between Auditory Attention and Oculomotor Control
    Zhao, Sijia
    Contadini-Wright, Claudia
    Chait, Maria
    JOURNAL OF NEUROSCIENCE, 2024, 44 (11)
  • [48] Impact of the spatial congruence of redundant targets on within-modal and cross-modal integration
    Girard, S.
    Pelland, M.
    Lepore, F.
    Collignon, O.
    EXPERIMENTAL BRAIN RESEARCH, 2013, 224 (02) : 275 - 285
  • [49] Cross-Modal Adaptive Interaction Network for RGB-D Saliency Detection
    Du, Qinsheng
    Bian, Yingxu
    Wu, Jianyu
    Zhang, Shiyan
    Zhao, Jian
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [50] Cross-modal exposure restores multisensory enhancement after hemianopia
    Bean, Naomi L.
    Stein, Barry E.
    Rowland, Benjamin A.
    CEREBRAL CORTEX, 2023, 33 (22) : 11036 - 11046