Interactions between acoustic challenges and processing depth in speech perception as measured by task-evoked pupil response

被引:2
作者
Shen, Jing [1 ]
Fitzgerald, Laura P. [1 ]
Kulick, Erin R. [2 ]
机构
[1] Temple Univ, Coll Publ Hlth, Dept Commun Sci & Disorders, Philadelphia, PA 19122 USA
[2] Temple Univ, Coll Publ Hlth, Dept Epidemiol & Biostat, Philadelphia, PA 19122 USA
来源
FRONTIERS IN PSYCHOLOGY | 2022年 / 13卷
基金
美国国家卫生研究院;
关键词
speech perception; processing effort; task-evoked pupil response; processing depth; speech in noise; FUNDAMENTAL-FREQUENCY CONTOURS; LISTENING EFFORT; GAZE POSITION; OLDER-ADULTS; HEARING-LOSS; INTELLIGIBILITY; LOAD; SIZE; MEMORY; COMPREHENSION;
D O I
10.3389/fpsyg.2022.959638
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Speech perception under adverse conditions is a multistage process involving a dynamic interplay among acoustic, cognitive, and linguistic factors. Nevertheless, prior research has primarily focused on factors within this complex system in isolation. The primary goal of the present study was to examine the interaction between processing depth and the acoustic challenge of noise and its effect on processing effort during speech perception in noise. Two tasks were used to represent different depths of processing. The speech recognition task involved repeating back a sentence after auditory presentation (higher-level processing), while the tiredness judgment task entailed a subjective judgment of whether the speaker sounded tired (lower-level processing). The secondary goal of the study was to investigate whether pupil response to alteration of dynamic pitch cues stems from difficult linguistic processing of speech content in noise or a perceptual novelty effect due to the unnatural pitch contours. Task-evoked peak pupil response from two groups of younger adult participants with typical hearing was measured in two experiments. Both tasks (speech recognition and tiredness judgment) were implemented in both experiments, and stimuli were presented with background noise in Experiment 1 and without noise in Experiment 2. Increased peak pupil dilation was associated with deeper processing (i.e., the speech recognition task), particularly in the presence of background noise. Importantly, there is a non-additive interaction between noise and task, as demonstrated by the heightened peak pupil dilation to noise in the speech recognition task as compared to in the tiredness judgment task. Additionally, peak pupil dilation data suggest dynamic pitch alteration induced an increased perceptual novelty effect rather than reflecting effortful linguistic processing of the speech content in noise. These findings extend current theories of speech perception under adverse conditions by demonstrating that the level of processing effort expended by a listener is influenced by the interaction between acoustic challenges and depth of linguistic processing. The study also provides a foundation for future work to investigate the effects of this complex interaction in clinical populations who experience both hearing and cognitive challenges.
引用
收藏
页数:13
相关论文
共 70 条
[1]  
[Anonymous], 1969, IEEE T ACOUST SPEECH, VAU17, P225
[2]   ADAPTATION TO AUDITORY STREAMING OF FREQUENCY-MODULATED TONES [J].
ANSTIS, S ;
SAIDA, S .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1985, 11 (03) :257-271
[3]  
Baayen R. H., 2008, ANAL LINGUISTIC DATA, DOI [10.1017/CBO9780511801686, DOI 10.1017/CBO9780511801686]
[4]   Random effects structure for confirmatory hypothesis testing: Keep it maximal [J].
Barr, Dale J. ;
Levy, Roger ;
Scheepers, Christoph ;
Tily, Harry J. .
JOURNAL OF MEMORY AND LANGUAGE, 2013, 68 (03) :255-278
[5]   TASK-EVOKED PUPILLARY RESPONSES, PROCESSING LOAD, AND THE STRUCTURE OF PROCESSING RESOURCES [J].
BEATTY, J .
PSYCHOLOGICAL BULLETIN, 1982, 91 (02) :276-292
[6]   The Pupillary Response to the Unknown: Novelty Versus Familiarity [J].
Beukema, Steve ;
Jennings, Ben J. ;
Olson, Jay A. ;
Kingdom, Frederick A. A. .
I-PERCEPTION, 2019, 10 (05)
[7]   The role of fundamental frequency contours in the perception of speech against interfering speech [J].
Binns, Christine ;
Culling, John F. .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2007, 122 (03) :1765-1776
[8]  
Boersma P., 2013, PRAAT DOING PHONETIC, V5
[9]  
Bunton K, 2001, CLIN LINGUIST PHONET, V15, P181
[10]   A unified model of the task-evoked pupil response [J].
Burlingham, Charlie S. ;
Mirbagheri, Saghar ;
Heeger, David J. .
SCIENCE ADVANCES, 2022, 8 (16)