Top-down modulation of neural envelope tracking: The interplay with behavioral, self-report and neural measures of listening effort

被引:29
作者
Decruy, Lien [1 ]
Lesenfants, Damien [1 ]
Vanthornhout, Jonas [1 ]
Francart, Tom [1 ]
机构
[1] Katholieke Univ Leuven, Dept Neurosci Res, Grp Expt Otorhinolaryngol ExpORL, Leuven, Belgium
基金
欧洲研究理事会; 欧盟地平线“2020”;
关键词
electroencephalography; listening effort; neural tracking of the speech envelope; speech; DUAL-TASK PARADIGMS; HEARING IMPAIRMENT; SPEECH ENVELOPE; PUPIL RESPONSE; AGE; TIME; LOAD; ENHANCEMENT; RECOGNITION; PERCEPTION;
D O I
10.1111/ejn.14753
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
When listening to natural speech, our brain activity tracks the slow amplitude modulations of speech, also called the speech envelope. Moreover, recent research has demonstrated that this neural envelope tracking can be affected by top-down processes. The present study was designed to examine if neural envelope tracking is modulated by the effort that a person expends during listening. Five measures were included to quantify listening effort: two behavioral measures based on a novel dual-task paradigm, a self-report effort measure and two neural measures related to phase synchronization and alpha power. Electroencephalography responses to sentences, presented at a wide range of subject-specific signal-to-noise ratios, were recorded in thirteen young, normal-hearing adults. A comparison of the five measures revealed different effects of listening effort as a function of speech understanding. Reaction times on the primary task and self-reported effort decreased with increasing speech understanding. In contrast, reaction times on the secondary task and alpha power showed a peak-shaped behavior with highest effort at intermediate speech understanding levels. With regard to neural envelope tracking, we found that the reaction times on the secondary task and self-reported effort explained a small part of the variability in theta-band envelope tracking. Speech understanding was found to strongly modulate neural envelope tracking. More specifically, our results demonstrated a robust increase in envelope tracking with increasing speech understanding. The present study provides new insights in the relations among different effort measures and highlights the potential of neural envelope tracking to objectively measure speech understanding in young, normal-hearing adults.
引用
收藏
页码:3375 / 3393
页数:19
相关论文
共 88 条
[51]   Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG [J].
O'Sullivan, James A. ;
Power, Alan J. ;
Mesgarani, Nima ;
Rajaram, Siddharth ;
Foxe, John J. ;
Shinn-Cunningham, Barbara G. ;
Slaney, Malcolm ;
Shamma, Shihab A. ;
Lalor, Edmund C. .
CEREBRAL CORTEX, 2015, 25 (07) :1697-1706
[52]   Adverse Listening Conditions and Memory Load Drive a Common Alpha Oscillatory Network [J].
Obleser, Jonas ;
Woestmann, Malte ;
Hellbernd, Nele ;
Wilsch, Anna ;
Maess, Burkhard .
JOURNAL OF NEUROSCIENCE, 2012, 32 (36) :12376-12383
[53]   Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation [J].
Ohlenforst, Barbara ;
Zekveld, Adriana A. ;
Lunner, Thomas ;
Wendt, Dorothea ;
Naylor, Graham ;
Wang, Yang ;
Versfeld, Niek J. ;
Kramer, Sophia E. .
HEARING RESEARCH, 2017, 351 :68-79
[54]   Effects of Hearing Impairment and Hearing Aid Amplification on Listening Effort: A Systematic Review [J].
Ohlenforst, Barbara ;
Zekveld, Adriana A. ;
Jansma, Elise P. ;
Wang, Yang ;
Naylor, Graham ;
Lorens, Artur ;
Lunner, Thomas ;
Kramer, Sophia E. .
EAR AND HEARING, 2017, 38 (03) :267-281
[55]   Validation of a simple response-time measure of listening effort [J].
Pals, Carina ;
Sarampalis, Anastasios ;
van Rijn, Hedderik ;
Baskent, Deniz .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (03) :EL187-EL192
[56]   Listening Effort: How the Cognitive Consequences of Acoustic Challenge Are Reflected in Brain and Behavior [J].
Peelle, Jonathan E. .
EAR AND HEARING, 2018, 39 (02) :204-214
[57]   Hearing Impairment and Cognitive Energy: The Framework for Understanding Effortful Listening (FUEL) [J].
Pichora-Fuller, M. Kathleen ;
Kramer, Sophia E. ;
Eckert, Mark A. ;
Edwards, Brent ;
Hornsby, Benjamin W. Y. ;
Humes, Larry E. ;
Lemke, Ulrike ;
Lunner, Thomas ;
Matthen, Mohan ;
Mackersie, Carol L. ;
Naylor, Graham ;
Phillips, Natalie A. ;
Richter, Michael ;
Rudner, Mary ;
Sommers, Mitchell S. ;
Tremblay, Kelly L. ;
Wingfield, Arthur .
EAR AND HEARING, 2016, 37 :5S-27S
[58]   The relationship between speech recognition, behavioural listening effort, and subjective ratings [J].
Picou, Erin M. ;
Ricketts, Todd A. .
INTERNATIONAL JOURNAL OF AUDIOLOGY, 2018, 57 (06) :457-467
[59]  
Picou EM, 2014, EAR HEARING, V35, P611, DOI 10.1097/AUD.0000000000000055
[60]   Visual Cues and Listening Effort: Individual Variability [J].
Picou, Erin M. ;
Ricketts, Todd A. ;
Hornsby, Benjamin W. Y. .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2011, 54 (05) :1416-1430