Data-driven voice source waveform analysis and synthesis

被引:10
作者
Gudnason, Jon [1 ]
Thomas, Mark R. P. [2 ]
Ellis, Daniel P. W.
Naylor, Patrick A. [2 ,3 ]
机构
[1] Reykjavik Univ, Sch Sci & Engn, Reykjavik, Iceland
[2] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2AZ, England
[3] Columbia Univ, LabROSA, New York, NY 10027 USA
关键词
Voice source signal; Inverse filtering; Vocal tract modeling; Principal component analysis; Gaussian mixture model; Segmental signal to reconstruction ratio; GLOTTAL CLOSURE; LINEAR PREDICTION; QUALITY; PHASE; MODEL;
D O I
10.1016/j.specom.2011.08.003
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
A data-driven approach is introduced for studying, analyzing and processing the voice source signal. Existing approaches parameterize the voice source signal by using models that are motivated, for example, by a physical model or function-fitting. Such parameterization is often difficult to achieve and it produces a poor approximation to a large variety of real voice source waveforms of the human voice. This paper presents a novel data-driven approach to analyze different types of voice source waveforms using principal component analysis and Gaussian mixture modeling. This approach models certain voice source features that many other approaches fail to model. Prototype voice source waveforms are obtained from each mixture component and analyzed with respect to speaker, phone and pitch. An analysis/synthesis scheme was set up to demonstrate the effectiveness of the method. Compression of the proposed voice source by discarding 75% of the features yields a segmental signal-to-reconstruction error ratio of 13 dB and a Bark spectral distortion of 0.14. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:199 / 211
页数:13
相关论文
共 53 条
[21]  
[Anonymous], P IEEE INT C AC SPEE
[22]  
[Anonymous], 2000, Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition
[23]  
[Anonymous], 25 STLQPSR DEP SPEEC
[24]   SPEECH ANALYSIS AND SYNTHESIS BY LINEAR PREDICTION OF SPEECH WAVE [J].
ATAL, BS ;
HANAUER, SL .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1971, 50 (02) :637-+
[25]   Time-domain parameterization of the closing phase of glottal airflow waveform from voices over a large intensity range [J].
Bäckström, T ;
Alku, P ;
Vilkman, E .
IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2002, 10 (03) :186-192
[26]  
BROOKES D.M., 1994, PROC I ACOUSTICS, V16, P501
[27]   ADAPTIVE WRLS-VFF FOR SPEECH ANALYSIS [J].
CHILDERS, DG ;
PRINCIPE, JC ;
TING, YT .
IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1995, 3 (03) :209-213
[28]   GLOTTAL MODELS FOR DIGITAL SPEECH PROCESSING - A HISTORICAL SURVEY AND NEW RESULTS [J].
CUMMINGS, KE ;
CLEMENTS, MA .
DIGITAL SIGNAL PROCESSING, 1995, 5 (01) :21-42
[29]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[30]  
Ding C., 2004, Proc. of Int'l Conf. Machine Learning, P225