Evaluation and usability of multimodal spoken language dialogue systems

被引:55
|
作者
Dybkjær, L
Bernsen, NO
Minker, W
机构
[1] Nat Interact Syst Lab, DK-5230 Odense M, Denmark
[2] Univ Ulm, Dept Informat Technol, D-89081 Ulm, Germany
关键词
evaluation projects; state-of-the-art; generalisations; guidelines; theory;
D O I
10.1016/j.specom.2004.02.001
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
With the technical advances and market growth in the field, the issues of evaluation and usability of spoken language dialogue systems, unimodal as well as multimodal, are as crucial as ever. This paper discusses those issues by reviewing a series of European and US projects which have produced major results on evaluation and usability. Whereas significant progress has been made on unimodal spoken language dialogue systems evaluation and usability, the emergence of, among others, multimodal, mobile, and domain-oriented systems continues to pose entirely new challenges to research in evaluation and usability. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:33 / 54
页数:22
相关论文
共 50 条
  • [1] Evaluation of spoken language understanding and dialogue systems
    Hildebrandt, B
    Rautenstrauch, H
    Sagerer, G
    ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, 1996, : 685 - 688
  • [2] Spoken language dialogue systems
    Giachin, E
    McGlashan, S
    CORPUS-BASED METHODS IN LANGUAGE AND SPEECH PROCESSING, 1997, 2 : 69 - 117
  • [3] Handbook of multimodal and spoken dialogue systems: Resources, terminology, and product evaluation
    van Deemter, K
    JOURNAL OF PRAGMATICS, 2003, 35 (08) : 1281 - 1285
  • [4] An Evaluation Framework for Natural Language Understanding in Spoken Dialogue Systems
    Gordon, Joshua B.
    Passonneau, Rebecca J.
    LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010, : 72 - 77
  • [5] Information seeking spoken dialogue systems - Part II: Multimodal dialogue
    Potamianos, Alexandros
    Fosler-Lussier, Eric
    Ammicht, Egbert
    Perakakis, Manolis
    IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (03) : 550 - 566
  • [6] Adaptive language models for spoken dialogue systems
    Solsona, RA
    Fosler-Lussier, E
    Kuo, HKJ
    Potamianos, A
    Zitouni, I
    2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 37 - 40
  • [7] Initial language models for spoken dialogue systems
    Kellner, A
    PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-6, 1998, : 185 - 188
  • [8] Recent trends in spoken language dialogue systems
    Minker, W.
    Albalate, A.
    Buehler, D.
    Pittermann, A.
    Pittermann, J.
    Strauss, P. -M.
    Zaykovskiy, D.
    INFORMATION PROCESSING IN THE SERVICE OF MANKIND AND HEALTH, 2006, : 693 - +
  • [9] Evaluation of Multimodal Dialogue Systems
    Bavarian Archive for Speech Signals, c/o Institut für Phonetik und Sprachliche Kommunikation, Ludwig-Maximilians-Universität Münchenn, Germany
    Cogn. Technol., 2006, (617-643):
  • [10] Spoken Dialogue Interfaces: Integrating Usability
    Spiliotopoulos, Dimitris
    Stavropoulou, Pepi
    Kouroupetroglou, Georgios
    HCI AND USABILITY FOR E-INCLUSION, PROCEEDINGS, 2009, 5889 : 484 - 499