The Evaluation of User Experience Testing for Retrieval-based Model and Deep Learning Conversational Agent

被引:2
作者
Leong P.H. [1 ]
Goh O.S. [2 ]
Kumar Y.J. [2 ]
Sam Y.H. [3 ]
Fong C.W. [1 ]
机构
[1] Faculty of Computing and Information Technology, Tunku Abdul Rahman University College (TAR UC), Johor
[2] Centre for Advanced Computing Technology, Faculty of Information and Communication Technology, Universiti Teknikal Malaysia Melaka (UTeM), Melaka
[3] Faculty of Accountancy, Finance and Business, Tunku Abdul Rahman University College (TAR UC), Johor
来源
Leong, Pui Huang | 1600年 / Science and Information Organization卷 / 12期
关键词
Conversational agent; deep learning; retrieval-based model; satisfaction; usability; usefulness; user experience testing;
D O I
10.14569/IJACSA.2021.0120429
中图分类号
学科分类号
摘要
The use of a conversational agent to relay information on behalf of individuals has gained worldwide acceptance. The conversational agent in this study was developed using Retrieval-based Model and Deep Learning to enhance the user experience. Nevertheless, the successfulness of the conversational agent could only be determined upon the evaluation. Thus, the testing was performed in the quantitative approach via questionnaire survey to capture user experience upon the usage of the conversational agent in terms of Usability, Usefulness and Satisfaction. The questionnaire survey was tested via statistical tool for reliability and validation test and proven to be carried out. The test results indicate positive experience towards the usage of the conversational agent and the outcome of the testing showed promising results and proof the success of this study, with immense contributions to the field of conversational agent. © 2021
引用
收藏
页码:216 / 221
页数:5
相关论文
共 19 条
[1]  
Duijst D., What is the effect of personalization on the UX of Chatbots?, (2020)
[2]  
Finstad K., The Usability Metric for User Experience, Interacting with Computers, 22, pp. 323-327, (2010)
[3]  
Davis F. D., A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results, (1985)
[4]  
Quarteroni S., Manandhar S., Designing and Interactive Open-Domain Question Answering System, Natural Language Engineering, 1, 1, pp. 1-23, (2008)
[5]  
Orlando T.M., Sunindyo W. D., Designing dashboard visualization for heterogeneous stakeholders (case study: ITB central library), 2017 International Conference on Data and Software Engineering (ICoDSE), pp. 1-6, (2017)
[6]  
Gil Rodriguez, Garcia-Zubia J., Orduna P., Villar-Martinez A., Lopez-De-Ipina D., New Approach for Conversational Agent Definition by Non-Programmers: A Visual Domain-Specific Language, IEEE Access, 7, pp. 5262-5276, (2018)
[7]  
Chancusing J.C., Bayona-Ore S., Information and Communication Technologies Acceptance Models in Universities, 2019 IEEE/ACIS 18th International Conference on Computer and Information Science (ICIS), pp. 62-66, (2019)
[8]  
Asastani H.L., Harisno V. H. Kusumawardhana, Warnars H. L. H. S., Factors Affecting the Usage of Mobile Commerce using Technology Acceptance Model (TAM) and Unified Theory of Acceptance and Use of Technology (UTAUT), 2018 Indonesian Association for Pattern Recognition International Conference (INAPR), pp. 322-328, (2018)
[9]  
Setianto F., Suharjito, Analysis the Acceptance of Use for Document Management System Using Technology Acceptance Model, 2018 Third International Conference on Informatics and Computing (ICIC), pp. 1-5, (2018)
[10]  
Harb Y., Alhayajneh S., Intention to use BI tools: Integrating technology acceptance model (TAM) and personality trait model, 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT), pp. 494-497, (2019)