<bold>ARTICULATORY FEATURE-BASED METHODS FOR ACOUSTIC AND AUDIO-VISUAL SPEECH RECOGNITION: SUMMARY FROM THE 2006 JHU SUMMERWORKSHOP</bold>

被引：0

作者：

Livescu, Karen ^{[1
]}

Cetin, Oezguer ^{[2
]}

Hasegawa-Johnson, Mark ^{[3
]}

King, Simon ^{[4
]}

Bartels, Chris ^{[5
]}

Borges, Nash ^{[6
]}

Kantor, Arthur ^{[3
]}

Lal, Partha ^{[4
]}

Yung, Lisa ^{[6
]}

Bezman, Ari ^{[7
]}

Dawson-Haggerty, Stephen ^{[8
]}

Woods, Bronwyn ^{[9
]}

Frankel, Joe ^{[2
,4
]}

Magimai-Doss, Mathew ^{[2
]}

Saenko, Kate ^{[1
]}

机构：

[1] MIT, Cambridge, MA 02139 USA

[2] ICSI, Hyderabad, Andhra Pradesh, India

[3] Univ Illinois, Champaign, IL USA

[4] Univ Edinburgh, Edinburgh EH8 9YL, Midlothian, Scotland

[5] Univ Washington, Seattle, WA 98195 USA

[6] Johns Hopkins Univ, Baltimore, MD 21218 USA

[7] Dartmouth Coll, Hanover, NH 03755 USA

[8] Harvard Univ, Cambridge, MA 02138 USA

[9] Swarthmore Coll, Swarthmore, PA 19081 USA

来源：

2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PTS 1-3 | 2007年

基金：

美国国家科学基金会; 瑞士国家科学基金会;

关键词：

speech recognition; speech processing;

D O I：

暂无

中图分类号：

O42 [声学];

学科分类号：

070206 ; 082403 ;

摘要：

We report on investigations, conducted at the 2006 Johns Hopkins Workshop, into the use of articulatory features (AFs) for observation and pronunciation models in speech recognition. In the area of observation modeling, we use the outputs of AF classifiers both directly, in an extension of hybrid HMM/neural network models, and as part of the observation vector, an extension of the "tandem" approach. In the area of pronunciation modeling, we investigate a model having multiple streams of AF states with soft synchrony constraints, for both audio-only and audio-visual recognition. The models are implemented as dynamic Bayesian networks, and tested on tasks from the Small-Vocabulary Switchboard (SVitchboard) corpus and the CUAVE audio-visual digits corpus. Finally, we analyze AF classification and forced alignment using a newly collected set of feature-level manual transcriptions.

引用

页码：621 / +

页数：2

共 24 条

[11] LIVESCU K, 2004, ICSLP
[12] LIVESCU K, 2007, IN PRESS JHU SUMM WO
[13] LIVESCU K, 2007, ICASSP
[14] Morgan N., 1995, IEEE Signal Processing Magazine, V12, P24, DOI 10.1109/79.382443
[15] Murphy K.P., 2002, Ph.D. Thesis
[16] NIYOGI P, 1999, AVSP
[17] OSTENDORF M, 1999, IEEE ASRU WORKSH
[18] Patterson E. K., 2002, ICASSP
[19] Recent advances in the automatic recognition of audiovisual speech
Potamianos, G
Neti, C
Gravier, G
Garg, A
Senior, AW
[J]. PROCEEDINGS OF THE IEEE, 2003, 91 (09) : 1306 - 1326
[20] ROSE RC, 1994, ICSLP

← 1 2 3 →