Language familiarity modulates relative attention to the eyes and mouth of a talker

被引:47
作者
Barenholtz, Elan [1 ,2 ]
Mavica, Lauren [2 ]
Lewkowicz, David J. [3 ]
机构
[1] Florida Atlantic Univ, Dept Psychol, Ctr Complex Syst & Brain Sci, Boca Raton, FL 34331 USA
[2] Florida Atlantic Univ, Dept Psychol, Boca Raton, FL 34331 USA
[3] Northeastern Univ, Dept Commun Sci & Disorders, Boston, MA 02115 USA
关键词
Multisensory; Speech; Language; Perception; Attention; AUDIOVISUAL SPEECH-PERCEPTION; NONNATIVE LISTENERS; SELECTIVE ATTENTION; NOISE; GAZE; FIXATIONS; EVOLUTION; BEHAVIOR; ENGLISH; FACE;
D O I
10.1016/j.cognition.2015.11.013
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We investigated whether the audiovisual speech cues available in a talker's mouth elicit greater attention when adults have to process speech in an unfamiliar language vs. a familiar language. Participants performed a speech-encoding task while watching and listening to videos of a talker in a familiar language (English) or an unfamiliar language (Spanish or Icelandic). Attention to the mouth increased in monolingual subjects in response to an unfamiliar language condition but did not in bilingual subjects when the task required speech processing. In the absence of an explicit speech-processing task, subjects attended equally to the eyes and mouth in response to both familiar and unfamiliar languages. Overall, these results demonstrate that language familiarity modulates selective attention to the redundant audiovisual speech cues in a talker's mouth in adults. When our findings are considered together with similar findings from infants, they suggest that this attentional strategy emerges very early in life. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:100 / 105
页数:6
相关论文
共 26 条
[1]   Social attention and real-world scenes: The roles of action, competition and social content [J].
Birmingham, Elina ;
Bischof, Walter F. ;
Kingstone, Alan .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2008, 61 (07) :986-998
[2]   Spatial statistics of gaze fixations during dynamic face processing [J].
Buchan, Julie N. ;
Pare, Martin ;
Munhall, Kevin G. .
SOCIAL NEUROSCIENCE, 2007, 2 (01) :1-13
[3]   Patterns of English phoneme confusions by native and non-native listeners [J].
Cutler, A ;
Weber, A ;
Smits, R ;
Cooper, N .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2004, 116 (06) :3668-3678
[4]  
DRIVER J, 1993, B PSYCHONOMIC SOC, V31, P45
[5]   The eyes have it: the neuroethology, function and evolution of social gaze [J].
Emery, NJ .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2000, 24 (06) :581-604
[6]  
GAT IB, 1978, AUDIOLOGY, V17, P339
[7]   Attention to facial regions in segmental and prosodic visual speech perception tasks [J].
Lansing, CR ;
McConkie, GW .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 1999, 42 (03) :526-539
[8]   Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences [J].
Lansing, IR ;
McConkie, GW .
PERCEPTION & PSYCHOPHYSICS, 2003, 65 (04) :536-552
[9]   Effect of masker type on native and non-native consonant perception in noise [J].
Lecumberri, MLG ;
Cooke, M .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2006, 119 (04) :2445-2454
[10]   Infants deploy selective attention to the mouth of a talking face when learning speech [J].
Lewkowicz, David J. ;
Hansen-Tift, Amy M. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (05) :1431-1436