Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:57
|
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 50 条
  • [1] A Cross-Modal Investigation of Statistical Learning in Developmental Dyslexia
    Kligler, Nitzan
    Gabay, Yafit
    SCIENTIFIC STUDIES OF READING, 2023, 27 (04) : 334 - 354
  • [2] The role of cross-modal associations in statistical learning
    Glicksohn, Arit
    Cohen, Asher
    PSYCHONOMIC BULLETIN & REVIEW, 2013, 20 (06) : 1161 - 1169
  • [3] Lack of Cross-Modal Effects in Dual-Modality Implicit Statistical Learning
    Li, Xiujun
    Zhao, Xudong
    Shi, Wendian
    Lu, Yang
    Conway, Christopher M.
    FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [4] Stimulus dependence and cross-modal interference in sequence learning
    Kemeny, Ferenc
    Nemeth, Kornel
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2017, 70 (12) : 2535 - 2547
  • [5] When Audition Dominates Vision Evidence From Cross-Modal Statistical Learning
    Robinson, Christopher W.
    Sloutsky, Vladimir M.
    EXPERIMENTAL PSYCHOLOGY, 2013, 60 (02) : 113 - 121
  • [6] Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information
    Baier, Bernhard
    Kleinschmidt, Andreas
    Mueller, Notger G.
    JOURNAL OF NEUROSCIENCE, 2006, 26 (47) : 12260 - 12265
  • [7] Cross-Modal Search for Social Networks via Adversarial Learning
    Zhou, Nan
    Du, Junping
    Xue, Zhe
    Liu, Chong
    Li, Jinxuan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
  • [8] Cross-modal contrastive learning for aspect-based recommendation
    Won, Heesoo
    Oh, Byungkook
    Yang, Hyeongjun
    Lee, Kyong-Ho
    INFORMATION FUSION, 2023, 99
  • [9] Manual directional gestures facilitate cross-modal perceptual learning
    Zhen, Anna
    Van Hedger, Stephen
    Heald, Shannon
    Goldin-Meadow, Susan
    Tian, Xing
    COGNITION, 2019, 187 : 178 - 187
  • [10] Anchors Aweigh: The Impact of Overlearning on Entrenchment Effects in Statistical Learning
    Bulgarelli, Federica
    Weiss, Daniel J.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2016, 42 (10) : 1621 - 1631