Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:57
|
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 50 条
  • [21] Cross-Modal Cue Effects in Motion Processing
    Hanada, G. M.
    Ahveninen, J.
    Calabro, F. J.
    Yengo-Kahn, A.
    Vaina, L. M.
    MULTISENSORY RESEARCH, 2019, 32 (01) : 45 - 65
  • [22] Laterality effects in cross-modal affective priming
    Harding, Jennifer
    Voyer, Daniel
    LATERALITY, 2016, 21 (4-6): : 585 - 605
  • [23] Effects of Age on Cross-Modal Emotion Perception
    Hunter, Edyta Monika
    Phillips, Louise H.
    MacPherson, Sarah E.
    PSYCHOLOGY AND AGING, 2010, 25 (04) : 779 - 787
  • [24] A Cross-Modal Study of Pain Across Communities in the United States
    Aggarwal, Arnav
    Rai, Sunny
    Giorgi, Salvatore
    Havaldar, Shreya
    Sherman, Garrick
    Mittal, Juhi
    Chandra, Sharath
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1050 - 1058
  • [25] A Survey of Full-Cycle Cross-Modal Retrieval: From a Representation Learning Perspective
    Wang, Suping
    Zhu, Ligu
    Shi, Lei
    Mo, Hao
    Tan, Songfu
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [26] Effects of Visual Information on Adults' and Infants' Auditory Statistical Learning
    Thiessen, Erik D.
    COGNITIVE SCIENCE, 2010, 34 (06) : 1093 - 1106
  • [27] Comparing statistical learning across perceptual modalities in infancy: An investigation of underlying learning mechanism(s)
    Emberson, Lauren L.
    Misyak, Jennifer B.
    Schwade, Jennifer A.
    Christiansen, Morten H.
    Goldstein, Michael H.
    DEVELOPMENTAL SCIENCE, 2019, 22 (06)
  • [28] Effects of healthy aging and left hemisphere stroke on statistical language learning
    Fama, Mackenzie E.
    Schuler, Kathryn D.
    Newport, Elissa L.
    Turkeltaub, Peter E.
    LANGUAGE COGNITION AND NEUROSCIENCE, 2022, 37 (08) : 984 - 999
  • [29] When Visual Distractors Predict Tactile Search: The Temporal Profile of Cross-Modal Spatial Learning
    Chen, Siyi
    Shi, Zhuanghua
    Mueller, Hermann J.
    Geyer, Thomas
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2021, 47 (09) : 1453 - 1470
  • [30] Aging effects and feasibility of statistical learning tasks across modalities
    Schevenels, Klara
    Altvater-Mackensen, Nicole
    Zink, Inge
    De Smedt, Bert
    Vandermosten, Maaike
    AGING NEUROPSYCHOLOGY AND COGNITION, 2023, 30 (02) : 201 - 230