EEG can predict speech intelligibility

被引:33
作者
Iotzov, Ivan [1 ]
Parra, Lucas C. [1 ]
机构
[1] CUNY City Coll, Biomed Engn, New York, NY 10031 USA
关键词
EEG; stimulus-response correlation; speech comprehension; speech intelligibility; CORTICAL ENTRAINMENT; NEURAL RESPONSES; COCKTAIL PARTY; THETA OSCILLATIONS; AUDITORY-CORTEX; ATTENTION; ENVELOPE; MOVEMENT; TRACKING; RELIES;
D O I
10.1088/1741-2552/ab07fe
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Speech signals have a remarkable ability to entrain brain activity to the rapid fluctuations of speech sounds. For instance, one can readily measure a correlation of the sound amplitude with the evoked responses of the electroencephalogram (EEG), and the strength of this correlation is indicative of whether the listener is attending to the speech. In this study we asked whether this stimulus-response correlation is also predictive of speech intelligibility. Approach. We hypothesized that when a listener fails to understand the speech in adverse hearing conditions, attention wanes and stimulus-response correlation also drops. To test this, we measure a listener's ability to detect words in noisy speech while recording their brain activity using EEG. We alter intelligibility without changing the acoustic stimulus by pairing it with congruent and incongruent visual speech. Main results. For almost all subjects we found that an improvement in speech detection coincided with an increase in correlation between the noisy speech and the EEG measured over a period of 30min. Significance. We conclude that simultaneous recordings of the perceived sound and the corresponding EEG response may be a practical tool to assess speech intelligibility in the context of hearing aids.
引用
收藏
页数:11
相关论文
共 56 条
[1]  
[Anonymous], FRONTIERS NEUROSCI
[2]   Cortical oscillations and sensory predictions [J].
Arnal, Luc H. ;
Giraud, Anne-Lise .
TRENDS IN COGNITIVE SCIENCES, 2012, 16 (07) :390-398
[3]   Untangling cross-frequency coupling in neuroscience [J].
Aru, Juhan ;
Aru, Jaan ;
Priesemann, Viola ;
Wibral, Michael ;
Lana, Luiz ;
Pipa, Gordon ;
Singer, Wolf ;
Vicente, Raul .
CURRENT OPINION IN NEUROBIOLOGY, 2015, 31 :51-61
[4]   Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario [J].
Biesmans, Wouter ;
Das, Neetha ;
Francart, Tom ;
Bertrand, Alexander .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (05) :402-412
[5]   Entrained theta oscillations guide perception of subsequent speech: behavioural evidence from rate normalisation [J].
Bosker, Hans Rutger ;
Ghitza, Oded .
LANGUAGE COGNITION AND NEUROSCIENCE, 2018, 33 (08) :955-967
[6]  
Calahorra Y, 2017, SCI REP-UK, V7, DOI [10.1038/srep40891, 10.1038/s41598-017-14611-6, 10.1038/s41598-017-04402-4]
[7]   The functional role of cross-frequency coupling [J].
Canolty, Ryan T. ;
Knight, Robert T. .
TRENDS IN COGNITIVE SCIENCES, 2010, 14 (11) :506-515
[8]   Eye Can Hear Clearly Now: Inverse Effectiveness in Natural Audiovisual Speech Processing Relies on Long-Term Crossmodal Temporal Integration [J].
Crosse, Michael J. ;
Di Liberto, Giovanni M. ;
Lalor, Edmund C. .
JOURNAL OF NEUROSCIENCE, 2016, 36 (38) :9888-9895
[9]   Congruent Visual Speech Enhances Cortical Entrainment to Continuous Auditory Speech in Noise-Free Conditions [J].
Crosse, Michael J. ;
Butler, John S. ;
Lalor, Edmund C. .
JOURNAL OF NEUROSCIENCE, 2015, 35 (42) :14195-14204
[10]   Machine learning for decoding listeners' attention from electroencephalography evoked by continuous speech [J].
de Taillez, Tobias ;
Kollmeier, Birger ;
Meyer, Bernd T. .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2020, 51 (05) :1234-1241