Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:57
|
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 50 条
  • [41] Cross-modal connectivity effects in age-related hearing loss
    Ponticorvo, Sara
    Manara, Renzo
    Cassandro, Ettore
    Canna, Antonietta
    Scarpa, Alfonso
    Troisi, Donato
    Cassandro, Claudia
    Cuoco, Sofia
    Cappiello, Arianna
    Pellecchia, Maria Teresa
    Di Salle, Francesco
    Esposito, Fabrizio
    NEUROBIOLOGY OF AGING, 2022, 111 : 1 - 13
  • [42] The effects of association strength and cross-modal correspondence on the development of multimodal stimuli
    Chan, Zara P. Y.
    Dyson, Benjamin J.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2015, 77 (02) : 560 - 570
  • [43] Incidental Category Learning and Cognitive Load in a Multisensory Environment Across Childhood
    Broadbent, H. J.
    Osborne, T.
    Rea, M.
    Peng, A.
    Mareschal, D.
    Kirkham, N. Z.
    DEVELOPMENTAL PSYCHOLOGY, 2018, 54 (06) : 1020 - 1028
  • [44] Discriminative Cross-Modal Transfer Learning and Densely Cross-Level Feedback Fusion for RGB-D Salient Object Detection
    Chen, Hao
    Li, Youfu
    Su, Dan
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (11) : 4808 - 4820
  • [45] Cross-situational statistical word learning in young children
    Suanda, Sumarga H.
    Mugwanya, Nassali
    Namy, Laura L.
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2014, 126 : 395 - 411
  • [46] Context influences conscious appraisal of cross situational statistical learning
    Poepsel, Timothy J.
    Weiss, Daniel J.
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [47] Cross-modal and modality-specific expectancy effects between pain and disgust
    Sharvit, Gil
    Vuilleumier, Patrik
    Delplanque, Sylvain
    Corradi-Dell'Acqua, Corrado
    SCIENTIFIC REPORTS, 2015, 5
  • [48] Assessing cross-modal target transition effects with a visual-auditory oddball
    Kiat, John E.
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2018, 129 : 58 - 66
  • [49] Incongruence effects in cross-modal emotional processing in autistic traits: An fMRI study
    Liu, Peipei
    Sutherland, Margaret
    Pollick, Frank E.
    NEUROPSYCHOLOGIA, 2021, 161
  • [50] The dissociation of semantically congruent and incongruent cross-modal effects on the visual attentional blink
    Zhao, Song
    Zhou, Yuxin
    Ma, Fangfang
    Xie, Jimei
    Feng, Chengzhi
    Feng, Wenfeng
    FRONTIERS IN NEUROSCIENCE, 2023, 17