Listening Effort During Sentence Processing Is Increased for Non-native Listeners: A Pupillometry Study

被引:63
作者
Borghini, Giulia [1 ]
Hazan, Valerie [1 ]
机构
[1] UCL, Fac Brain Sci, Dept Speech Hearing & Phonet Sci, London, England
基金
英国经济与社会研究理事会;
关键词
non-native speech perception; pupillometry; listening effort; speech perception in noise; cognitive load; PUPIL-DILATION; SPEECH; RECOGNITION; NOISE; ACQUISITION; PERCEPTION; IMPACT; LOAD; AGE;
D O I
10.3389/fnins.2018.00152
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Current evidence demonstrates that even though some non-native listeners can achieve native-like performance for speech perception tasks in quiet, the presence of a background noise is much more detrimental to speech intelligibility for non-native compared to native listeners. Even when performance is equated across groups, it is likely that greater listening effort is required for non-native listeners. Importantly, the added listening effort might result in increased fatigue and a reduced ability to successfully perform multiple tasks simultaneously. Task-evoked pupil responses have been demonstrated to be a reliable measure of cognitive effort and can be useful in clarifying those aspects. In this study we compared the pupil response for 23 native English speakers and 27 Italian speakers of English as a second language. Speech intelligibility was tested for sentences presented in quiet and in background noise at two performance levels that were matched across groups. Signal-to-noise levels corresponding to these sentence intelligibility levels were pre-determined using an adaptive intelligibility task. Pupil response was significantly greater in non-native compared to native participants across both intelligibility levels. Therefore, for a given intelligibility level, a greater listening effort is required when listening in a second language in order to understand speech in noise. Results also confirmed that pupil response is sensitive to speech intelligibility during language comprehension, in line with previous research. However, contrary to our predictions, pupil response was not differentially modulated by intelligibility levels for native and non-native listeners. The present study corroborates that pupillometry can be deemed as a valid measure to be used in speech perception investigation, because it is sensitive to differences both across participants, such as listener type, and across conditions, such as variations in the level of speech intelligibility. Importantly, pupillometry offers us the possibility to uncover differences in listening effort even when those do not emerge in the performance level of individuals.
引用
收藏
页数:13
相关论文
共 41 条
[1]   Are individual differences in speech reception related to individual differences in cognitive ability? A survey of twenty experimental studies with normal and hearing-impaired adults [J].
Akeroyd, Michael A. .
INTERNATIONAL JOURNAL OF AUDIOLOGY, 2008, 47 :S53-S71
[2]  
Bates D., 2020, lme4: linear mixed-effects models using Eigen and S4. R package version 1.1-7, V1, P1, DOI DOI 10.18637/JSS.V067.I01
[3]   How Linguistic Closure and Verbal Working Memory Relate to Speech Recognition in Noise-A Review [J].
Besser, Jana ;
Koelewijn, Thomas ;
Zekveld, Adriana A. ;
Kramer, Sophia E. ;
Festen, Joost M. .
TRENDS IN AMPLIFICATION, 2013, 17 (02) :75-93
[4]   Semantic and phonetic enhancements for speech-in-noise recognition by native and non-native listeners [J].
Bradlow, Ann R. ;
Alexander, Jennifer A. .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2007, 121 (04) :2339-2349
[5]   Competition dynamics of second-language listening [J].
Broersma, Mirjam ;
Cutler, Anne .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2011, 64 (01) :74-95
[6]   Bilingual infants control their languages as they listen [J].
Byers-Heinlein, Krista ;
Morin-Lessard, Elizabeth ;
Lew-Williams, Casey .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (34) :9032-9037
[7]   New Sentence Recognition Materials Developed Using a Basic Non-Native English Lexicon [J].
Calandruccio, Lauren ;
Smiljanic, Rajka .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2012, 55 (05) :1342-1355
[8]  
Cohen J., 1988, STAT POWER ANAL BEHA, DOI [10.4324/9780203771587, DOI 10.4324/9780203771587]
[9]   Asymmetric mapping from phonetic to lexical representations in second-language listening [J].
Cutler, A ;
Weber, A ;
Otake, T .
JOURNAL OF PHONETICS, 2006, 34 (02) :269-284
[10]   Consonant identification in noise by native and non-native listeners: Effects of local context [J].
Cutler, Anne ;
Garcia Lecumberri, Maria Luisa ;
Cooke, Martin .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2008, 124 (02) :1264-1268