The perception of intonational and emotional speech prosody produced with and without a face mask: an exploratory individual differences study

被引:0
作者
Chloe Sinagra
Seth Wiener
机构
[1] Carnegie Mellon University,Language Acquisition, Processing, and Pedagogy Lab, Department of Modern Languages
来源
Cognitive Research: Principles and Implications | / 7卷
关键词
Face masks; Speech perception; Prosody; Intonation; Emotion; Individual differences; Autism; Memory;
D O I
暂无
中图分类号
学科分类号
摘要
Face masks affect the transmission of speech and obscure facial cues. Here, we examine how this reduction in acoustic and facial information affects a listener’s understanding of speech prosody. English sentence pairs that differed in their intonational (statement/question) and emotional (happy/sad) prosody were created. These pairs were recorded by a masked and unmasked speaker and manipulated to contain audio or not. This resulted in a continuum from typical unmasked speech with audio (easiest) to masked speech without audio (hardest). English listeners (N = 129) were tested on their discrimination of these statement/question and happy/sad pairs. We also collected six individual difference measures previously reported to affect various linguistic processes: Autism Spectrum Quotient, musical background, phonological short-term memory (digit span, 2-back), and congruence task (flanker, Simon) behavior. The results indicated that masked statement/question and happy/sad prosodies were harder to discriminate than unmasked prosodies. Masks can therefore make it more difficult to understand a speaker’s intended intonation or emotion. Importantly, listeners differed considerably in their ability to understand prosody. When wearing a mask, speakers should try to speak clearer and louder, if possible, and make intentions and emotions explicit to the listener.
引用
收藏
相关论文
共 204 条
[51]  
Cavallaro G(2021)Impacts of face coverings on communication: An indirect impact of COVID-19 International Journal of Audiology 55 661-undefined
[52]  
Di Nicola V(2003)Vocal communication of emotion: A review of research paradigms Speech Communication 4 46-undefined
[53]  
Quaranta N(2021)Face masks and speaking style affect audio–visual word recognition and memory of native and non-native speech The Journal of the Acoustical Society of America 2006 10-undefined
[54]  
Fowler CA(1999)Emotion in speech: The acoustic attributes of fear, anger, sadness, and joy Journal of Psycholinguistic Research 16 e0246842-undefined
[55]  
Gandour J(2003)Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English Language and Speech 52 1-undefined
[56]  
Dzemidzic M(2020)The role of working memory in children's ability for prosodic discrimination PLoS ONE 4 824-undefined
[57]  
Wong D(2005)The role of gestures and facial cues in second language listening comprehension Language Learning undefined undefined-undefined
[58]  
Lowe M(2004)Decoding speech prosody: Do music lessons help? Emotion undefined undefined-undefined
[59]  
Tong Y(2006)Converting video formats with FFmpeg Linux Journal undefined undefined-undefined
[60]  
Hsieh L(2021)Effects of face masks on speech recognition in multi-talker babble noise PLoS ONE undefined undefined-undefined