Lip Feature Analyzing in Speech Synthesis System for Speech Impaired

被引：0

作者：

Wang Mengjun ^{[1
]}

Li Gang ^{[2
]}

机构：

[1] HeBei Univ Technol, Sch Informat Engn, Tianjin, Peoples R China

[2] Tianjin Univ, Sch Precis Instrument Optoelect Engn, Tianjin, Peoples R China

来源：

2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL II | 2010年

关键词：

rehabilitation; lipreading; unsymmetrical lip contour model; difference parameters; HMM;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

A speech synthesis system based on lipreading technique was investigated for rehabilitation. In order to acquire more features of lip contours and improve the recognizing rate of lipreading, a new unsymmetrical lip contour model was analyzed to extract the degree of pouting, and the differential coefficients of some parameters were calculated to describe dynamic character of the lip contour. Experiments were carried out in a small database of isolated Chinese phonemes based on Hidden Markov Model (HMM) recognizer. Compared to the traditional symmetrical lip contour model, the new parameters from the unsymmetrical lip contour model improve the recognizing rate more than 25%.

引用

页码：161 / 164

页数：4

共 10 条

[1] Visual Speech Recognition: a solution from feature extraction to words classification [J].

Da Silveira, L ;

Facon, J ;

Borges, DL .

XVI BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2003, :399-405

[2] A multi-stream audio-video large-vocabulary Mandarin Chinese speech database [J].

Liang, LH ;

Luo, Y ;

Huang, FY ;

Nefian, AV .

2004 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXP (ICME), VOLS 1-3, 2004, :1787-1790

[3] Extraction of visual features for lipreading [J].

Matthews, I ;

Cootes, TF ;

Bangham, JA ;

Cox, S ;

Harvey, R .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (02) :198-213

[4] Feature analysis for automatic speechreading [J].

Scanlon, P ;

Reilly, R .

2001 IEEE FOURTH WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 2001, :625-630

[5] Recognition of sequence lip images and its application [J].

Wang, R ;

Yao, HX ;

Gao, W .

ICSP '98: 1998 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PROCEEDINGS, VOLS I AND II, 1998, :849-854

[6]

Wang SL, 2004, 2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 2, PROCEEDINGS, P101

[7]

WANG Zhiming, 2002, YINGYOUNG SHENGXUE, V21, P29

[8]

Williams JJ, 2000, INT CONF ACOUST SPEE, P2393, DOI 10.1109/ICASSP.2000.859323

[9]

Zhang X, 2002, INT CONF ACOUST SPEE, P1993

[10]

Zhi Q, 2001, P IEEE INT C MULT EX, P136

← 1 →