Learning Across Senses: Cross-Modal Effects in Multisensory Statistical Learning

被引:58
作者
Mitchel, Aaron D. [1 ]
Weiss, Daniel J. [1 ]
机构
[1] Penn State Univ, Dept Psychol, University Pk, PA 16802 USA
基金
美国国家卫生研究院;
关键词
multimodal statistical learning; multisensory perception; speech segmentation; WORD SEGMENTATION; SPEECH SEGMENTATION; VISUAL INFORMATION; TONE SEQUENCES; INFANTS; CUES; CONSTRAINTS; PERFORMANCE; ATTENTION; LANGUAGE;
D O I
10.1037/a0023700
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with auditory and visual streams. After establishing baseline rates of learning for each stream independently, they systematically varied the amount of audiovisual correspondence across 3 experiments. They found that learners were able to segment both streams successfully only when the boundaries of the audio and visual triplets were in alignment. This pattern of results suggests that learners are able to extract multiple statistical regularities across modalities provided that there is some degree of cross-modal coherence. They discuss the implications of their results in light of recent claims that multisensory statistical learning is guided by modality-independent mechanisms.
引用
收藏
页码:1081 / 1091
页数:11
相关论文
共 41 条
[1]  
Aslin R.N., 2009, INFANT PATHWAYS LANG, P15
[2]   Grounding conceptual knowledge in modality-specific systems [J].
Barsalou, LW ;
Simmons, WK ;
Barbey, AK ;
Wilson, CD .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (02) :84-91
[3]   Is the auditory sensory memory sensitive to visual information? [J].
Besle, J ;
Fort, A ;
Giard, MH .
EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :337-344
[4]  
Boersma P., 2008, PRAAT DOING PHONETIC
[5]   Statistical learning within and between modalities - Pitting abstract against stimulus-specific representations [J].
Conway, Christopher M. ;
Christiansen, Morten H. .
PSYCHOLOGICAL SCIENCE, 2006, 17 (10) :905-912
[6]   Seeing and hearing in space and time: Effects of modality and presentation rate on implicit statistical learning [J].
Conway, Christopher M. ;
Christiansen, Morten H. .
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2009, 21 (04) :561-580
[7]   Modality-constrained statistical learning of tactile, visual, and auditory sequences [J].
Conway, CM ;
Christiansen, MH .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2005, 31 (01) :24-39
[8]   Distant. melodies: Statistical learning of nonadjacent dependencies in tone sequences [J].
Creel, SC ;
Newport, EL ;
Aslin, RN .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2004, 30 (05) :1119-1130
[9]   Speech segmentation is facilitated by visual cues [J].
Cunillera, Toni ;
Camara, Estela ;
Laine, Matti ;
Rodriguez-Fornells, Antoni .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2010, 63 (02) :260-274
[10]   Beneficial effects of word final stress in segmenting a new language:: evidence from ERPs [J].
Cunillera, Toni ;
Gomila, Antoni ;
Rodriguez-Fornells, Antoni .
BMC NEUROSCIENCE, 2008, 9 (1)