Visual speech information: A help or hindrance in perceptual processing of dysarthric speech

被引:10
作者
Borrie, Stephanie A. [1 ]
机构
[1] Utah State Univ, Dept Communicat Disorders & Deaf Educ, Logan, UT 84322 USA
关键词
UNDERLIE IMPROVED RECOGNITION; WORD RECOGNITION; INTELLIGIBILITY; INTEGRATION; LISTENERS; CUES; SENTENCES; HEARING; FAMILIARIZATION; SEGMENTATION;
D O I
10.1121/1.4913770
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study investigated the influence of visual speech information on perceptual processing of neurologically degraded speech. Fifty listeners identified spastic dysarthric speech under both audio (A) and audiovisual (AV) conditions. Condition comparisons revealed that the addition of visual speech information enhanced processing of the neurologically degraded input in terms of (a) acuity (percent phonemes correct) of vowels and consonants and (b) recognition (percent words correct) of predictive and nonpredictive phrases. Listeners exploited stress-based segmentation strategies more readily in AV conditions, suggesting that the perceptual benefit associated with adding visual speech information to the auditory signal-the AV advantage-has both segmental and suprasegmental origins. Results also revealed that the magnitude of the AV advantage can be predicted, to some degree, by the extent to which an individual utilizes syllabic stress cues to inform word recognition in AV conditions. Findings inform the development of a listener-specific model of speech perception that applies to processing of dysarthric speech in everyday communication contexts. (C) 2015 Acoustical Society of America.
引用
收藏
页码:1473 / 1480
页数:8
相关论文
共 50 条
[11]   Audio-visual interactions with intact clearly audible speech [J].
Davis, C ;
Kim, J .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY, 2004, 57 (06) :1103-1121
[12]   Patients' experiences of disruptions associated with post-stroke dysarthria [J].
Dickson, Sylvia ;
Barbour, Rosaline S. ;
Brady, Marian ;
Clark, Alexander M. ;
Paton, Gillian .
INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2008, 43 (02) :135-153
[13]   Effects of audio-visual information on the intelligibility of alaryngeal speech [J].
Evitts, Paul M. ;
Portugal, Lindsay ;
Van Dine, Ami ;
Holler, Aline .
JOURNAL OF COMMUNICATION DISORDERS, 2010, 43 (02) :92-104
[14]   Evaluating the Effort Expended to Understand Speech in Noise Using a Dual-Task Paradigm: The Effects of Providing Visual Speech Cues [J].
Fraser, Sarah ;
Gagne, Jean-Pierre ;
Alepins, Majolaine ;
Dubois, Pascale .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 2010, 53 (01) :18-33
[15]  
Garcia J. M., 1992, ANN CONV AM SPEECH L
[16]   Dysarthric sentence intelligibility: Contribution of iconic gestures and message predictiveness [J].
Garcia, JM ;
Dagenais, PA .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 1998, 41 (06) :1282-1293
[17]   Measures of auditory-visual integration in nonsense syllables and sentences [J].
Grant, KW ;
Seitz, PF .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1998, 104 (04) :2438-2450
[18]   Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration [J].
Grant, KW ;
Walden, BE ;
Seitz, PF .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1998, 103 (05) :2677-2690
[19]   The use of visible speech cues for improving auditory detection of spoken sentences [J].
Grant, KW ;
Seitz, PF .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2000, 108 (03) :1197-1208
[20]   Auditory and auditory-visual perception of clear and conversational speech [J].
Helfer, KS .
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 1997, 40 (02) :432-443