Improving Semi-supervised Deep Neural Network. for Keyword Search in Low Resource Languages

被引:0
作者
Hsiao, Roger [1 ]
Ng, Tim [1 ]
Le Zhang [1 ]
Ranjan, Shivesh [1 ]
机构
[1] Raytheon BBN Technol, 10 Moulton St, Cambridge, MA 02138 USA
来源
15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4 | 2014年
关键词
semi-supervised training; deep neural network; keyword search;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we investigate how to improve semi-supervised DNN for low resource languages where the initial systems may have high error rate. We propose using semi-supervised MLP features for DNN training, and we also explore using confidence to improve semi-supervised cross entropy and sequence training. The work conducted in this paper was evaluated under the IARPA Babel program for the keyword spotting tasks. We focus on the limited condition where there are around 10 hours of supervised data for training.
引用
收藏
页码:1088 / 1091
页数:4
相关论文
共 36 条
  • [31] ReconVAT: A Semi-Supervised Automatic Music Transcription Framework for Low-Resource Real-World Data
    Cheuk, Kin Wai
    Herremans, Dorien
    Su, Li
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3918 - 3926
  • [32] X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing data
    Hong, Danfeng
    Yokoya, Naoto
    Xia, Gui-Song
    Chanussot, Jocelyn
    Zhu, Xiao Xiang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 167 : 12 - 23
  • [33] Deep Neural Network Supervised Bandwidth Allocation Decisions for Low-Latency Heterogeneous E-Health Networks
    Ruan, Lihua
    Dias, Maluge Pubuduni Imali
    Wong, Elaine
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (16) : 4147 - 4154
  • [34] KL-divergence Regularized Deep Neural Network Adaptation for Low-resource Speaker-dependent Speech Enhancement
    Chai, Li
    Du, Jun
    Lee, Chin-Hui
    INTERSPEECH 2019, 2019, : 1806 - 1810
  • [35] Deep neural network based interactive fuzzy Bayesian search algorithm for low-cost smart farming automation model
    Sivaraj, Aparna
    Palanisamy, Valarmathie
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (27)
  • [36] Deep Neural Network based Feature Extraction Using Convex-nonnegative Matrix Factorization for Low-resource Speech Recognition
    Qin, Chuxiong
    Zhang, Lianhai
    2016 IEEE INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC), 2016, : 1082 - 1086