A Generative Data Augmentation Model for Enhancing Chinese Dialect Pronunciation Prediction

被引:3
作者
Lin, Chu-Cheng [1 ]
Tsai, Richard Tzong-Han [2 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10617, Taiwan
[2] Yuan Ze Univ, Dept Comp Sci & Engn, Zhongli 320, Taiwan
来源
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING | 2012年 / 20卷 / 04期
关键词
Chinese dialects; data augmentation; generative model; pronunciation database;
D O I
10.1109/TASL.2011.2172424
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Most spoken Chinese dialects lack comprehensive digital pronunciation databases, which are crucial for speech processing tasks. Given complete pronunciation databases for related dialects, one can use supervised learning techniques to predict a Chinese character's pronunciation in a target dialect based on the character's features and its pronunciation in other related dialects. Unfortunately, Chinese dialect pronunciation databases are far from complete. We propose a novel generative model that makes use of both existing dialect pronunciation data plus medieval rime books to discover patterns that exist in multiple dialects. The proposed model can augment missing dialectal pronunciations based on existing dialect pronunciation tables (even if incomplete) and the pronunciation data in rime books. The augmented pronunciation database can then be used in supervised learning settings. We evaluate the prediction accuracy in terms of phonological features, such as tone, initial phoneme, final phoneme, etc. For each character, features are evaluated on the whole, overall pronunciation feature accuracy (OPFA). Our first experimental results show that adding features from dialectal pronunciation data to our baseline rime-book model dramatically improves OPFA using the support vector machine (SVM) model. In the second experiment, we compare the performance of the SVM model using phonological features from closely related dialects with that of the model using phonological features from non-closely related dialects. The experimental results show that using features from closely related dialects results in higher accuracy. In the third experiment, we show that using our proposed data augmentation model to fill in missing data can increase the SVM model's OPFA by up to 7.6%.
引用
收藏
页码:1109 / 1117
页数:9
相关论文
共 29 条
  • [1] Allen W.Sidney., 1978, VOX LATINA GUIDE PRO, V2nd
  • [2] Ang U.-J., 1999, P 6 INT 17 NAT C CHI
  • [3] [Anonymous], 2008, PARAMETER ESTIMATION
  • [4] [Anonymous], 2007, P 45 ANN M ASS COMP
  • [5] [Anonymous], 1998, CMUDICT CMU PRONOUNC
  • [6] Ben-Hamed M., 2006, DIACHRONICA, V23, P29, DOI DOI 10.1075/DIA.23.1.04HAM
  • [7] Berg-Kirkpatrick T., 2010, P ANN C N AM CHAPT A, P582
  • [8] Latent Dirichlet allocation
    Blei, DM
    Ng, AY
    Jordan, MI
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (4-5) : 993 - 1022
  • [9] Bouchard-Cote A., 2007, P EMP METH NAT LANG
  • [10] Mutual intelligibility of Chinese dialects experimentally tested
    Chaoju, Tang
    van Heuven, Vincent J.
    [J]. LINGUA, 2009, 119 (05) : 709 - 732