User-centered evaluation of question answering systems

被引:1
作者
Ong, Chorng-Shyong [1 ]
Day, Min-Yuh [2 ]
Chen, Kuo-Tay [3 ]
Hsu, Wen-Lian [4 ]
机构
[1] Natl Taiwan Univ, Dept Informat Management, Taipei, Taiwan
[2] Natl Taiwan Univ, Academis Sinica, Taiwan & Inst Informat Sci, Dept Informat & Management, Taipei, Taiwan
[3] Natl Taiwan Univ, Dept Accounting, Taipei, Taiwan
[4] Acad Sinica, Inst Informat Sci, Taipei, Taiwan
来源
ISI 2008: 2008 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS | 2008年
关键词
evaluation; measurement; question answering system; user satisfaction;
D O I
10.1109/ISI.2008.4565087
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid growth of the Internet and database technologies in recent years, question answering systems (QAS) have emerged as important applications. As most evaluation models focus on system-centered evaluation, user-centered evaluation has attracted little attention. Although many QAS have been implemented, little work has been done on the development of a user-centered evaluation for QAS. User-centered evaluation is used to understand a user's needs and identify important dimensions and factors in the development of an information system in order to improve its acceptance. The purpose of this study is to develop a user-centered evaluation model for QAS from the user's perspective. The proposed user-centered evaluation model provides a framework for the design of question answering systems from the user's perspective to enhance user satisfaction and acceptance of QAS.
引用
收藏
页码:286 / +
页数:2
相关论文
共 10 条
  • [1] THE THEORY OF PLANNED BEHAVIOR
    AJZEN, I
    [J]. ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1991, 50 (02) : 179 - 211
  • [2] USER ACCEPTANCE OF COMPUTER-TECHNOLOGY - A COMPARISON OF 2 THEORETICAL-MODELS
    DAVIS, FD
    BAGOZZI, RP
    WARSHAW, PR
    [J]. MANAGEMENT SCIENCE, 1989, 35 (08) : 982 - 1003
  • [3] Fishbein M., 1975, Beliefs, Attitude, Intention and Behavior: An Introduction to Theory and Research
  • [4] Leveraging Question Answer technology to address terrorism inquiry
    Schumaker, Robert P.
    Chen, Hsinchun
    [J]. DECISION SUPPORT SYSTEMS, 2007, 43 (04) : 1419 - 1430
  • [5] Evaluating the efficacy of - A terrorism question/answer system
    Schumaker, Robert P.
    Liu, Ying
    Ginsburg, Mark
    Chen, Hsinchun
    [J]. COMMUNICATIONS OF THE ACM, 2007, 50 (07) : 74 - 80
  • [6] An evaluation of the chat and knowledge delivery components of a low-level dialog system: The AZ-ALICE experiment
    Schumaker, Robert P.
    Ginsburg, Mark
    Chen, Hsinchun
    Liu, Ying
    [J]. DECISION SUPPORT SYSTEMS, 2007, 42 (04) : 2236 - 2246
  • [7] User acceptance of information technology: Toward a unified view
    Venkatesh, V
    Morris, MG
    Davis, GB
    Davis, FD
    [J]. MIS QUARTERLY, 2003, 27 (03) : 425 - 478
  • [8] A model for quantitative evaluation of an end-to-end question-answering system
    Wacholder, Nina
    Kelly, Diane
    Kantor, Paul
    Rittman, Robert
    Sun, Ying
    Bai, Bing
    Small, Sharon
    Yamrom, Boris
    Strzalkowski, Tomek
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (08): : 1082 - 1099
  • [9] A theoretical integration of user satisfaction and technology acceptance
    Wixom, BH
    Todd, PA
    [J]. INFORMATION SYSTEMS RESEARCH, 2005, 16 (01) : 85 - 102
  • [10] Development, implementation, and a cognitive evaluation of a definitional question answering system for physicians
    Yu, Hong
    Lee, Minsuk
    Kaufman, David
    Ely, John
    Osheroff, Jerome A.
    Hripcsak, George
    Cimino, James
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2007, 40 (03) : 236 - 251