The perception of intonational and emotional speech prosody produced with and without a face mask: an exploratory individual differences study

被引:0
作者
Chloe Sinagra
Seth Wiener
机构
[1] Carnegie Mellon University,Language Acquisition, Processing, and Pedagogy Lab, Department of Modern Languages
来源
Cognitive Research: Principles and Implications | / 7卷
关键词
Face masks; Speech perception; Prosody; Intonation; Emotion; Individual differences; Autism; Memory;
D O I
暂无
中图分类号
学科分类号
摘要
Face masks affect the transmission of speech and obscure facial cues. Here, we examine how this reduction in acoustic and facial information affects a listener’s understanding of speech prosody. English sentence pairs that differed in their intonational (statement/question) and emotional (happy/sad) prosody were created. These pairs were recorded by a masked and unmasked speaker and manipulated to contain audio or not. This resulted in a continuum from typical unmasked speech with audio (easiest) to masked speech without audio (hardest). English listeners (N = 129) were tested on their discrimination of these statement/question and happy/sad pairs. We also collected six individual difference measures previously reported to affect various linguistic processes: Autism Spectrum Quotient, musical background, phonological short-term memory (digit span, 2-back), and congruence task (flanker, Simon) behavior. The results indicated that masked statement/question and happy/sad prosodies were harder to discriminate than unmasked prosodies. Masks can therefore make it more difficult to understand a speaker’s intended intonation or emotion. Importantly, listeners differed considerably in their ability to understand prosody. When wearing a mask, speakers should try to speak clearer and louder, if possible, and make intentions and emotions explicit to the listener.
引用
收藏
相关论文
共 204 条
  • [1] Anwyl-Irvine AL(2020)Gorilla in our midst: An online behavioral experiment builder Behavior Research Methods 52 388-407
  • [2] Massonnié J(1984)Exploring the articulatory loop The Quarterly Journal of Experimental Psychology 36 233-252
  • [3] Flitton A(1996)Acoustic profiles in vocal emotion expression Journal of Personality and Social Psychology 70 614-636
  • [4] Kirkham N(2005)The role of intonation in emotional expressions Speech Communication 46 252-267
  • [5] Evershed JK(2001)The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians Journal of Autism and Developmental Disorders 31 5-17
  • [6] Baddeley A(2013)Random effects structure for confirmatory hypothesis testing: Keep it maximal Journal of Memory and Language 68 255-278
  • [7] Lewis V(2018)What makes a word prominent? Predicting untrained German listeners’ perceptual judgments Journal of Phonetics 70 20-38
  • [8] Vallar G(2014)Cognitive control in bilinguals: Advantages in stimulus–stimulus inhibition Bilingualism: Language and Cognition 17 610-629
  • [9] Banse R(2021)An introduction to linear mixed-effects modeling in R Advances in Methods and Practices in Psychological Science 6 49-809
  • [10] Scherer KR(2021)Face mask type affects audiovisual speech intelligibility and subjective listening effort in young and older adults Cognitive Research: Principles and Implications 8 803-31