Evaluation of AI-Based Digital Assistants in Smart Manufacturing

被引:11
作者
Bousdekis, Alexandros [1 ]
Mentzas, Gregoris [1 ]
Apostolou, Dimitris [1 ,2 ]
Wellsandt, Stefan [3 ]
机构
[1] Natl Tech Univ Athens NTUA, Inst Commun & Comp Syst ICCS, Informat Management Unit IMU, Athens, Greece
[2] Univ Piraeus, Dept Informat, Piraeus, Greece
[3] Univ Bremen, BIBA Bremer Inst Prod & Logist GmbH, Bremen, Germany
来源
ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: SMART MANUFACTURING AND LOGISTICS SYSTEMS: TURNING IDEAS INTO ACTION, APMS 2022, PT II | 2022年 / 664卷
基金
欧盟地平线“2020”;
关键词
Industry; 5.0; Evaluation methodology; Trustworthy AI; Voice-enabled assistant; MENTAL WORKLOAD; COGNITIVE LOAD; NASA-TLX;
D O I
10.1007/978-3-031-16411-8_58
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Industry 5.0 complements the Industry 4.0 paradigm by highlighting research and innovation as drivers for a transition to a sustainable, human-centric and resilient industry. In this context, new types of interactions between operators and machines are facilitated, that can be realized through artificial intelligence (AI) based and voice-enabled Digital Intelligent Assistants (DIA). Apart from the existing technological challenges, this direction requires new methodologies for the evaluation of such technological solutions that will be able to treat AI in manufacturing as a socio-technical system. In this paper, we propose a framework for the evaluation of voice-enabled AI solutions in Industry 5.0, which consists of four dimensions: the trustworthiness of the AI system; the usability of the DIA; the cognitive workload of individual users; and the overall business benefits for the corporation.
引用
收藏
页码:503 / 510
页数:8
相关论文
共 38 条
[1]   Towards a More Nuanced View of Vocal Attractiveness [J].
Babel, Molly ;
McGuire, Grant ;
King, Joseph .
PLOS ONE, 2014, 9 (02)
[2]   A Predictive Analytics Infrastructure to Support a Trustworthy Early Warning System [J].
Baneres, David ;
Guerrero-Roldan, Ana Elena ;
Rodriguez-Gonzalez, M. Elena ;
Karadeniz, Abdulkadir .
APPLIED SCIENCES-BASEL, 2021, 11 (13)
[3]   Human-AI Collaboration in Quality Control with Augmented Manufacturing Analytics [J].
Bousdekis, Alexandros ;
Wellsandt, Stefan ;
Bosani, Enrica ;
Lepenioti, Katerina ;
Apostolou, Dimitris ;
Hribernik, Karl ;
Mentzas, Gregoris .
ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: ARTIFICIAL INTELLIGENCE FOR SUSTAINABLE AND RESILIENT PRODUCTION SYSTEMS, APMS 2021, PT IV, 2021, 633 :303-310
[4]   On the ability of virtual agents to decrease cognitive load: an experimental study [J].
Brachten, Florian ;
Bruenker, Felix ;
Frick, Nicholas R. J. ;
Ross, Bjoern ;
Stieglitz, Stefan .
INFORMATION SYSTEMS AND E-BUSINESS MANAGEMENT, 2020, 18 (02) :187-207
[5]  
Brooke J., 1996, USABILITY EVALUATION, P189
[6]   NASA TLX: Software for assessing subjective mental workload [J].
Cao, Alex ;
Chintamani, Keshav K. ;
Pandya, Abhilash K. ;
Ellis, R. Darin .
BEHAVIOR RESEARCH METHODS, 2009, 41 (01) :113-117
[7]   Examining Effort in 1D Uncertainty Communication Using Individual Differences in Working Memory and NASA-TLX [J].
Castro, Spencer C. ;
Hosseinpour, Helia ;
Quinan, P. Samuel ;
Padilla, Lace .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (01) :411-421
[8]   "What Can I Help You With?": Infrequent Users' Experiences of Intelligent Personal Assistants [J].
Cowan, Benjamin R. ;
Pantidi, Nadia ;
Coyle, David ;
Morrissey, Kellie ;
Clarke, Peter ;
Al-Shehri, Sara ;
Earley, David ;
Bandeira, Natasha .
PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI '17), 2017,
[9]   Hybrid Intelligence [J].
Dellermann, Dominik ;
Ebel, Philipp ;
Soellner, Matthias ;
Leimeister, Jan Marco .
BUSINESS & INFORMATION SYSTEMS ENGINEERING, 2019, 61 (05) :637-643
[10]  
Dhiman H., 2022, BUS INFORM SYST ENG+, P1, DOI DOI 10.1007/S12599-022-00743-1