Comparison of the ITU-T P.85 Standard to Other Methods for the Evaluation of Text-to-Speech Systems

被引：0

作者：

Sityaev, Dmitry ^{[1
]}

Knill, Katherine ^{[1
]}

Burrows, Tina ^{[1
]}

机构：

[1] Toshiba Res Europe Ltd, Speech Technol Grp, Cambridge Res Lab, Cambridge CB2 3NH, England

来源：

INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5 | 2006年

关键词：

speech synthesis; evaluation;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Evaluation of TTS systems is essential to assess performance. The ITU-T P.85 standard was introduced in 1994 to assess the overall quality of speech synthesis systems. However it has not been widely accepted or used. This paper compares the ITU test to more commonly used tests for intelligibility (semantically unpredictable sentences (SUS)) and naturalness (mean opinion score based). The aim of this research was to determine if the ITU test can provide a better performance measure and/or supplementary information to help evaluate TTS systems.

引用

页码：1077 / 1080

页数：4

共 10 条

[1] ALVAREZ Y, 2002, P ICSLP
[2] [Anonymous], 2002, CAMBRIDGE U ENG DEP
[3] The SUS test: A method for the assessment of text-to-speech synthesis intelligibility using Semantically Unpredictable Sentences
Benoit, C
Grice, M
Hazan, V
[J]. SPEECH COMMUNICATION, 1996, 18 (04) : 381 - 392
[4] *CCITT, 1984, REB BOOK S14, V5
[5] Gibbon D., 1997, Handbook of standards and resources for spoken language systems
[6] *ITU T, 1994, INT TEL UN PUBL
[7] The role of speech processing in human-computer intelligent communication
Kamm, C
Walker, M
Rabiner, L
[J]. SPEECH COMMUNICATION, 1997, 23 (04) : 263 - 278
[8] Expanding the MOS: Development and psychometric evaluation of the MOS-R and MOS-X
Polkosky, Melanie D.
Lewis, James R.
[J]. International Journal of Speech Technology, 2003, 6 (02) : 161 - 182
[9] SLUIJTER A, 1998, P 3 ESCA WORKSH SPEE
[10] Measuring speech quality for text-to-speech systems: development and assessment of a modified mean opinion score (MOS) scale
Viswanathan, M
Viswanathan, M
[J]. COMPUTER SPEECH AND LANGUAGE, 2005, 19 (01) : 55 - 83

← 1 →