AN AUTO-ENCODER BASED APPROACH TO UNSUPERVISED LEARNING OF SUBWORD UNITS

被引:0
作者
Badino, Leonardo [1 ]
Canevari, Claudia [1 ]
Fadiga, Luciano [1 ]
Metta, Giorgio [1 ]
机构
[1] Ist Italiano Tecnol, Genoa, Italy
来源
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2014年
关键词
unsupervised acoustic modeling; auto-encoders; deep learning;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In this paper we propose an autoencoder-based method for the unsupervised identification of subword units. We experiment with different types and architectures of autoencoders to asses what autoencoder properties are most important for this task. We first show that the encoded representation of speech produced by standard autencoders is more effective than Gaussian posteriorgrams in a spoken query classification task. Finally we evaluate the subword inventories produced by the proposed method both in terms of classification accuracy in a word classification task (with lexicon size up to 263 words) and in terms of consistency between subword transcription of different word examples of a same word type. The evaluation is carried out on Italian and American English datasets.
引用
收藏
页数:5
相关论文
共 17 条
  • [1] [Anonymous], 2009, ADV NEURAL INFORM PR
  • [2] [Anonymous], 2006, P ICASSP
  • [3] [Anonymous], 1952, PRELIMINARIES SPEECH
  • [4] [Anonymous], IEEE INT C AC SPEECH
  • [5] Joint lexicon, acoustic unit inventory and model design
    Bacchiani, M
    Ostendorf, M
    [J]. SPEECH COMMUNICATION, 1999, 29 (2-4) : 99 - 114
  • [6] Bengio Y., 2007, LEARNING DEEP ARCHIT
  • [7] Coates A., 2011, AISTATS 14
  • [8] Garofolo J. S., 1993, TIMIT ACOUSTIC PHONE
  • [9] Grimaldi M., 2008, P LANGTECH ROM IT
  • [10] Reducing the dimensionality of data with neural networks
    Hinton, G. E.
    Salakhutdinov, R. R.
    [J]. SCIENCE, 2006, 313 (5786) : 504 - 507