User modeling for spoken dialogue system evaluation

被引：63
|
作者：
Eckert, W
Levin, E
Pieraccini, R
机构：
来源：
1997 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING, PROCEEDINGS | 1997年
关键词：
D O I：
10.1109/ASRU.1997.658991
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Automatic speech dialogue systems are becoming common. Zn order to assess their performance, a large sample of real dialogues has to be collected and evaluated. This process is expensive, labor intensive, hind prone to errors. To alleviate this situation we propose a user simulation to conduct dialogues with the system under investigation. Using stochastic modeling of real users we can both debug and evaluate a speech dialogue system while it is still in the lab, thus substantially reducing the amount, of field testing with real users.
引用
收藏
页码：80 / 87
页数：8
相关论文
共 50 条
  • [1] Modeling user behavior online for disambiguating user input in a spoken dialogue system
    Wang, Fangju
    Swegles, Kyle
    SPEECH COMMUNICATION, 2013, 55 (01) : 84 - 98
  • [2] User Simulation for Spoken Dialogue Systems: Learning and Evaluation
    Georgila, Kallirroi
    Henderson, James
    Lenzon, Oliver
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1065 - 1068
  • [3] Designing the user interface for a natural spoken dialogue system
    Boyce, SJ
    DESIGN OF COMPUTING SYSTEMS: SOCIAL AND ERGONOMIC CONSIDERATIONS, 1997, 21 : 367 - 370
  • [4] User Modeling in Spoken Dialogue Systems to Generate Flexible Guidance
    Kazunori Komatani
    Shinichi Ueno
    Tatsuya Kawahara
    Hiroshi G. Okuno
    User Modeling and User-Adapted Interaction, 2005, 15 : 169 - 183
  • [5] User modeling in spoken dialogue systems to generate flexible guidance
    Komatani, K
    Ueno, S
    Kawahara, T
    Okuno, HG
    USER MODELING AND USER-ADAPTED INTERACTION, 2005, 15 (1-2) : 169 - 183
  • [6] Real user evaluation of a POMDP spoken dialogue system using automatic belief compression
    Crook, Paul A.
    Keizer, Simon
    Wang, Zhuoran
    Tang, Wenshuo
    Lemon, Oliver
    COMPUTER SPEECH AND LANGUAGE, 2014, 28 (04): : 873 - 887
  • [7] Simulated Spoken Dialogue System Based on IOHMM with User History
    Li, Changliang
    Xu, Bo
    Wang, XiuYing
    Ge, WenDong
    Hao, HongWei
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 83 - 92
  • [8] Managing Speaker Identity and User Profiles in a Spoken Dialogue System
    Lucas, J. M.
    Fernandez, F.
    Salazar, J.
    Ferreiros, J.
    San Segundo, R.
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2009, (43): : 77 - 84
  • [9] EVALUATION OF A SPOKEN DIALOGUE SYSTEM FOR CONTROLLING A HIFI AUDIO SYSTEM
    Martinez, F. Fernandez
    Blazquez, J.
    Ferreiros, J.
    Barra, R.
    Macias-Guarasa, J.
    Lucas-Cuesta, J. M.
    2008 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY: SLT 2008, PROCEEDINGS, 2008, : 137 - +
  • [10] A Model of Temporally Changing User Behaviors in a Deployed Spoken Dialogue System
    Komatani, Kazunori
    Kawahara, Tatsuya
    Okuno, Hiroshi G.
    USER MODELING, ADAPTATION, AND PERSONALIZATION, PROCEEDINGS, 2009, 5535 : 409 - 414
12345