Intonation Units in Spontaneous Speech Evoke a Neural Response

被引:3
作者
Inbar, Maya [1 ,2 ,3 ]
Genzer, Shir [2 ]
Perry, Anat [2 ]
Grossman, Eitan [1 ]
Landau, Ayelet N. [2 ,3 ]
机构
[1] Hebrew Univ Jerusalem, Dept Linguist, IL-9190501 Jerusalem, Israel
[2] Hebrew Univ Jerusalem, Dept Psychol, IL-9190501 Jerusalem, Israel
[3] Hebrew Univ Jerusalem, Dept Cognit & Brain Sci, IL-9190501 Jerusalem, Israel
基金
欧洲研究理事会; 以色列科学基金会;
关键词
delta-band speech tracking; electroencephalography; general linear model; intonation units; speech prosody; spontaneous speech processing; COMPUTATIONAL PRINCIPLES; PROSODY; OSCILLATIONS; CLAUSE; PERCEPTION; LISTENERS; GRAMMAR; SYNTAX; CUES;
D O I
10.1523/JNEUROSCI.0235-23.2023
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Spontaneous speech is produced in chunks called intonation units (IUs). IUs are defined by a set of prosodic cues and presumably occur in all human languages. Recent work has shown that across different grammatical and sociocultural conditions IUs form rhythms of similar to 1 unit per second. Linguistic theory suggests that IUs pace the flow of information in the discourse. As a result, IUs provide a promising and hitherto unexplored theoretical framework for studying the neural mechanisms of communication. In this article, we identify a neural response unique to the boundary defined by the IU. We measured the EEG of human participants (of either sex), who listened to different speakers recounting an emotional life event. We analyzed the speech stimuli linguistically and modeled the EEG response at word offset using a GLM approach. We find that the EEG response to IU-final words differs from the response to IU-nonfinal words even when equating acoustic boundary strength. Finally, we relate our findings to the body of research on rhythmic brain mechanisms in speech processing. We study the unique contribution of IUs and acoustic boundary strength in predicting delta-band EEG. This analysis suggests that IU-related neural activity, which is tightly linked to the classic Closure Positive Shift (CPS), could be a time-locked component that captures the previously characterized delta-band neural speech tracking.
引用
收藏
页码:8189 / 8200
页数:12
相关论文
共 50 条
[31]   A stochastic model of intonation for text-to-speech synthesis [J].
Véronis, J ;
Di Cristo, P ;
Courtois, F ;
Chaumette, C .
SPEECH COMMUNICATION, 1998, 26 (04) :233-244
[32]   Intonation and Prosody Conversion for Expressive Mandarin Speech Synthesis [J].
Zhu, Jing ;
Yu, Yibiao .
PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, :549-552
[33]   Listeners' comprehension of uptalk in spontaneous speech [J].
Tomlinson, John M., Jr. ;
Tree, Jean E. Fox .
COGNITION, 2011, 119 (01) :58-69
[34]   Spontaneous Neural Activity in the Superior Temporal Gyrus Recapitulates Tuning for Speech Features [J].
Breshears, Jonathan D. ;
Hamilton, Liberty S. ;
Chang, Edward F. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
[35]   Prosodic disturbance in aphasia: speech timing versus intonation production [J].
Seddoh, SA .
CLINICAL LINGUISTICS & PHONETICS, 2004, 18 (01) :17-38
[36]   Spontaneous neural activity underlying neutral and happy speech recognition in noise and its association with psychiatric symptoms in patients with schizophrenia [J].
Wu, Chao ;
She, Shenglin ;
Gong, Bingyan ;
Li, Qiuhong ;
Xia, Yu ;
Lu, Xiaohua ;
Liu, Yi ;
Wu, Huawang ;
Zheng, Yingjun .
SCHIZOPHRENIA RESEARCH, 2024, 274 :90-97
[37]   Leveraging Prosody for Punctuation Prediction of Spontaneous Speech [J].
Cho, Jenny Yeonjin ;
Ng, Sara ;
Trang Tran ;
Ostendorf, Mari .
INTERSPEECH 2022, 2022, :555-559
[38]   Effects of acoustic periodicity and intelligibility on the neural oscillations in response to speech [J].
Steinmetzger, Kurt ;
Rosen, Stuart .
NEUROPSYCHOLOGIA, 2017, 95 :173-181
[39]   Atypical neural oscillations in response to speech in infants and children with speech and language impairments: a systematic review [J].
Nallet, Caroline ;
Gervain, Judit .
HEARING BALANCE AND COMMUNICATION, 2022, 20 (03) :145-154
[40]   Temporal neural dynamics of understanding communicative intentions from speech prosody [J].
Gao, Panke ;
Jiang, Zhufang ;
Yang, Yufang ;
Zheng, Yuanyi ;
Feng, Gangyi ;
Li, Xiaoqing .
NEUROIMAGE, 2024, 299