Continuous Noise Masking Based Vocoder for Statistical Parametric Speech Synthesis

被引:2
|
作者
Al-Radhi, Mohammed Salah [1 ]
Csapo, Tamas Gabor [1 ,2 ]
Nemeth, Geza [1 ]
机构
[1] Budapest Univ Technol & Econ, Dept Telecommun & Media Informat, H-1117 Budapest, Hungary
[2] MTA ELTE Lendulet Lingual Articulat Res Grp, H-1088 Budapest, Hungary
关键词
noise masking; continuous vocoder; speech synthesis; phase distortion; kernel density functions; SYNTHESIS SYSTEM; MODEL;
D O I
10.1587/transinf.2019EDP7167
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we propose a method called "continuous noise masking (cNM)" that allows eliminating residual buzziness in a continuous vocoder, i.e. of which all parameters are continuous and offers a simple and flexible speech analysis and synthesis system. Traditional parametric vocoders generally show a perceptible deterioration in the quality of the synthesized speech due to different processing algorithms. Furthermore, an inaccurate noise resynthesis (e.g. in breathiness or hoarseness) is also considered to be one of the main underlying causes of performance degradation, leading to noisy transients and temporal discontinuity in the synthesized speech. To overcome these issues, a new cNM is developed based on the phase distortion deviation in order to reduce the perceptual effect of the residual noise, allowing a proper reconstruction of noise characteristics, and model better the creaky voice segments that may happen in natural speech. To this end, the cNM is designed to keep only voice components under a condition of the cNM threshold while discarding others. We evaluate the proposed approach and compare with state-of-the-art vocoders using objective and subjective listening tests. Experimental results show that the proposed method can reduce the effect of residual noise and can reach the quality of other sophisticated approaches like STRAIGHT and log domain pulse model (PML).
引用
收藏
页码:1099 / 1107
页数:9
相关论文
共 50 条
  • [1] A Continuous Vocoder Using Sinusoidal Model for Statistical Parametric Speech Synthesis
    Al-Radhi, Mohammed Salah
    Csapo, Tamas Gabor
    Nemeth, Geza
    SPEECH AND COMPUTER (SPECOM 2018), 2018, 11096 : 11 - 20
  • [2] Time-domain envelope modulating the noise component of excitation in a continuous residual-based vocoder for statistical parametric speech synthesis
    Al-Radhi, Mohammed Salah
    Csapo, Tamas Gabor
    Nemeth, Geza
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 434 - 438
  • [3] Continuous Wavelet Vocoder-based Decomposition of Parametric Speech Waveform Synthesis
    Al-Radhi, Mohammed Salah
    Csapo, Tamas Gabor
    Zainko, Csaba
    Nemeth, Geza
    INTERSPEECH 2021, 2021, : 2212 - 2216
  • [4] WAVEFFJORD: FFJORD-BASED VOCODER FOR STATISTICAL PARAMETRIC SPEECH SYNTHESIS
    Wu, Ning-Qian
    Ling, Zhen-Hua
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 7214 - 7218
  • [5] SAMPLERNN-BASED NEURAL VOCODER FOR STATISTICAL PARAMETRIC SPEECH SYNTHESIS
    Ai, Yang
    Wu, Hong-Chuan
    Ling, Zhen-Hua
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 5659 - 5663
  • [6] A continuous vocoder for statistical parametric speech synthesis and its evaluation using an audio-visual phonetically annotated Arabic corpus
    Al-Radhi, Mohammed Salah
    Abdo, Omnia
    Csapo, Tamas Gabor
    Abdou, Sherif
    Nemeth, Geza
    Fashal, Mervat
    COMPUTER SPEECH AND LANGUAGE, 2020, 60
  • [7] Denoising-and-Dereverberation Hierarchical Neural Vocoder for Statistical Parametric Speech Synthesis
    Ai, Yang
    Ling, Zhen-Hua
    Wu, Wei-Lu
    Li, Ang
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 : 2036 - 2048
  • [8] A Neural Vocoder With Hierarchical Generation of Amplitude and Phase Spectra for Statistical Parametric Speech Synthesis
    Ai, Yang
    Ling, Zhen-Hua
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 (839-851) : 839 - 851
  • [9] Statistical parametric speech synthesis
    Zen, Heiga
    Tokuda, Keiichi
    Black, Alan W.
    SPEECH COMMUNICATION, 2009, 51 (11) : 1039 - 1064
  • [10] Adaptive Refinements of Pitch Tracking and HNR Estimation within a Vocoder for Statistical Parametric Speech Synthesis
    Al-Radhi, Mohammed Salah
    Csapo, Tamas Gabor
    Nemeth, Geza
    APPLIED SCIENCES-BASEL, 2019, 9 (12):