Rhythmicity and cross-modal temporal cues facilitate detection

被引:60
|
作者
ten Oever, Sanne [1 ]
Schroeder, Charles E. [2 ,3 ,4 ]
Poeppel, David [5 ]
van Atteveldt, Nienke [1 ,6 ,7 ]
Zion-Golumbic, Elana [2 ,3 ,4 ,8 ]
机构
[1] Maastricht Univ, Fac Psychol & Neurosci, NL-6200 MD Maastricht, Netherlands
[2] Columbia Univ, Med Ctr, Dept Psychiat, New York, NY 10032 USA
[3] Columbia Univ, Med Ctr, Dept Neurol, New York, NY 10032 USA
[4] Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USA
[5] NYU, Dept Psychol, New York, NY 10003 USA
[6] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, Amsterdam, Netherlands
[7] Vrije Univ Amsterdam, Inst Learn, Amsterdam, Netherlands
[8] Bar Ilan Univ, Gonda Brain Res Ctr, Ramat Gan, Israel
关键词
Temporal prediction; Audiovisual integration; Rhythmicity; Detection; LOW-FREQUENCY OSCILLATIONS; NEURONAL OSCILLATIONS; MULTISENSORY INTEGRATION; AUDITORY DETECTION; VISUAL SPEECH; ATTENTION; DYNAMICS; RECALIBRATION; ENTRAINMENT; COMBINATION;
D O I
10.1016/j.neuropsychologia.2014.08.008
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Temporal structure in the environment often has predictive value for anticipating the occurrence of forthcoming events. In this study we investigated the influence of two types of predictive temporal information on the perception of near-threshold auditory stimuli: 1) intrinsic temporal rhythmicity within an auditory stimulus stream and 2) temporally-predictive visual cues. We hypothesized that combining predictive temporal information within- and across-modality should decrease the threshold at which sounds are detected, beyond the advantage provided by each information source alone. Two experiments were conducted in which participants had to detect tones in noise. Tones were presented in either rhythmic or random sequences and were preceded by a temporally predictive visual signal in half of the trials. We show that detection intensities are lower for rhythmic (vs. random) and audiovisual (vs. auditory-only) presentation, independent from response bias, and that this effect is even greater for rhythmic audiovisual presentation. These results suggest that both types of temporal information are used to optimally process sounds that occur at expected points in time (resulting in enhanced detection), and that multiple temporal cues are combined to improve temporal estimates. Our findings underscore the flexibility and proactivity of the perceptual system which uses within- and across-modality temporal cues to anticipate upcoming events and process them optimally. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:43 / 50
页数:8
相关论文
共 50 条
  • [21] Cerebral Correlates and Statistical Criteria of Cross-Modal Face and Voice Integration
    Love, Scott A.
    Pollick, Frank E.
    Latinus, Marianne
    SEEING AND PERCEIVING, 2011, 24 (04): : 351 - 367
  • [22] Cross-Modal Phase Reset Predicts Auditory Task Performance in Humans
    Thorne, Jeremy D.
    De Vos, Maarten
    Viola, Filipa Campos
    Debener, Stefan
    JOURNAL OF NEUROSCIENCE, 2011, 31 (10) : 3853 - 3861
  • [23] Interregional alpha-band synchrony supports temporal cross-modal integration
    van Driel, Joram
    Knapen, Tomas
    van Es, Daniel M.
    Cohen, Michael X.
    NEUROIMAGE, 2014, 101 : 404 - 415
  • [24] Cross-Modal Conflict Increases With Time-on-Task in a Temporal Discrimination Task
    Matuz, Andras
    Van der Linden, Dimitri
    Topa, Kristof
    Csatho, Arpad
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [25] Improving visual spatial working memory in younger and older adults: effects of cross-modal cues
    Curtis, Ashley F.
    Turner, Gary R.
    Park, Norman W.
    Murtha, Susan J. E.
    AGING NEUROPSYCHOLOGY AND COGNITION, 2019, 26 (01) : 24 - 43
  • [26] Visual and cross-modal cues increase the identification of overlapping visual stimuli in Balint's syndrome
    D'Imperio, Daniela
    Scandola, Michele
    Gobbetto, Valeria
    Bulgarelli, Cristina
    Salgarello, Matteo
    Avesani, Renato
    Moro, Valentina
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2017, 39 (08) : 786 - 802
  • [27] Integration of haptic and visual size cues in perception and action revealed through cross-modal conflict
    Pettypiece, Charles E.
    Goodale, Melvyn A.
    Culham, Jody C.
    EXPERIMENTAL BRAIN RESEARCH, 2010, 201 (04) : 863 - 873
  • [28] RGBD Salient Object Detection via Disentangled Cross-Modal Fusion
    Chen, Hao
    Deng, Yongjian
    Li, Youfu
    Hung, Tzu-Yi
    Lin, Guosheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 8407 - 8416
  • [29] THE EFFECTS OF CROSS-MODAL MANIPULATIONS OF ATTENTION ON THE DETECTION OF VIBROTACTILE STIMULI IN HUMANS
    POST, LJ
    CHAPMAN, CE
    SOMATOSENSORY AND MOTOR RESEARCH, 1991, 8 (02) : 149 - 157
  • [30] Integration of haptic and visual size cues in perception and action revealed through cross-modal conflict
    Charles E. Pettypiece
    Melvyn A. Goodale
    Jody C. Culham
    Experimental Brain Research, 2010, 201 : 863 - 873