Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:57
|
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 50 条
  • [31] Effects of trial history on cross-modal non-spatial inhibition of return
    Zhang Ming
    Sang Hanbin
    Lu Ke
    Wang Aijun
    ACTA PSYCHOLOGICA SINICA, 2021, 53 (07) : 681 - 693
  • [32] Effects of simultaneously presented visual information on adults' and infants' auditory statistical learning
    Thiessen, Erik D.
    COGNITION IN FLUX, 2010, : 1368 - 1373
  • [33] Statistical learning of multisensory regularities is enhanced in musicians: An MEG study
    Paraskevopoulos, Evangelos
    Chalas, Nikolas
    Kartsidis, Panagiotis
    Wollbrink, Andreas
    Bamidis, Panagiotis
    NEUROIMAGE, 2018, 175 : 150 - 160
  • [34] Continual learning for cross-modal image-text retrieval based on domain-selective attention
    Yang, Rui
    Wang, Shuang
    Gu, Yu
    Wang, Jihui
    Sun, Yingzhi
    Zhang, Huan
    Liao, Yu
    Jiao, Licheng
    PATTERN RECOGNITION, 2024, 149
  • [35] Cross-modal effects of value on perceptual acuity and stimulus encoding
    Pooresmaeili, Arezoo
    FitzGerald, Thomas H. B.
    Bach, Dominik R.
    Toelch, Ulf
    Ostendorf, Florian
    Dolan, Raymond J.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (42) : 15244 - 15249
  • [36] Effects of Cross-modal Asynchrony on Informational Masking in Human Cortex
    Hausfeld, Lars
    Gutschalk, Alexander
    Formisano, Elia
    Riecke, Lars
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2017, 29 (06) : 980 - 990
  • [37] Age-Related Effects on Cross-Modal Duration Perception
    Scurry, Alexandra N.
    Dutcher, Dustin
    Werner, John S.
    Jiang, Fang
    MULTISENSORY RESEARCH, 2019, 32 (08) : 693 - 714
  • [38] Perceive, Reason, and Align: Context-guided cross-modal correlation learning for image-text retrieval
    Liu, Zheng
    Pei, Xinlei
    Gao, Shanshan
    Li, Changhao
    Wang, Jingyao
    Xu, Junhao
    APPLIED SOFT COMPUTING, 2024, 154
  • [39] No reliable effect of task-irrelevant cross-modal statistical regularities on distractor suppression
    Jagini, Kishore Kumar
    Sunny, Meera Mary
    CORTEX, 2023, 161 : 77 - 92
  • [40] Flexible Visual Statistical Learning: Transfer Across Space and Time
    Turk-Browne, Nicholas B.
    Scholl, Brian J.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2009, 35 (01) : 195 - 202