Assessment of a large language model based digital intelligent assistant in assembly manufacturing

被引:10
作者
Colabianchi, Silvia [1 ]
Costantino, Francesco [1 ]
Sabetta, Nicolo [1 ]
机构
[1] Sapienza Univ Rome, Dept Comp Control & Management Engn Antonio Rubert, Via Ariosto 25, I-00185 Rome, Italy
关键词
Chatbot; Experimental design; Artificial intelligence; Natural language processing; Industry; 4.0; 5.0; INDUSTRY; 4.0; TRAINING SYSTEM;
D O I
10.1016/j.compind.2024.104129
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The use of Digital Intelligent Assistants (DIAs) in manufacturing aims to enhance performance and reduce cognitive workload. By leveraging the advanced capabilities of Large Language Models (LLMs), the research aims to understand the impact of DIAs on assembly processes, emphasizing human-centric design and operational efficiency. The study is novel in considering the three primary objectives: evaluating the technical robustness of DIAs, assessing their effect on operators' cognitive workload and user experience, and determining the overall performance improvement of the assembly process. Methodologically, the research employs a laboratory experiment, incorporating a controlled setting to meticulously assess the DIA's performance. The experiment used a between-subjects design comparing a group of participants using the DIA against a control group relying on traditional manual methods across a series of assembly tasks. Findings reveal a significant enhancement in the operators' experience, a reduction in cognitive load, and an improvement in the quality of process outputs when the DIA is employed. The article contributes to the study of the DIA's potential and AI integration in manufacturing, offering insights into the design, development, and evaluation of DIAs in industrial settings.
引用
收藏
页数:21
相关论文
共 59 条
[1]  
[Anonymous], 2017, Meta. FAISS.
[2]   An empirical evaluation of the System Usability Scale [J].
Bangor, Aaron ;
Kortum, Philip T. ;
Miller, James T. .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2008, 24 (06) :574-594
[3]  
Bernabei M, 2023, Computers and Education Artificial Intelligence, V5, P100172, DOI [10.1016/j.caeai.2023.100172, 10.1016/j.caeai.2023.100172, DOI 10.1016/J.CAEAI.2023.100172, DOI 10.1016/J.CAEAI]
[4]   Evaluation of AI-Based Digital Assistants in Smart Manufacturing [J].
Bousdekis, Alexandros ;
Mentzas, Gregoris ;
Apostolou, Dimitris ;
Wellsandt, Stefan .
ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: SMART MANUFACTURING AND LOGISTICS SYSTEMS: TURNING IDEAS INTO ACTION, APMS 2022, PT II, 2022, 664 :503-510
[5]   Human-AI Collaboration in Quality Control with Augmented Manufacturing Analytics [J].
Bousdekis, Alexandros ;
Wellsandt, Stefan ;
Bosani, Enrica ;
Lepenioti, Katerina ;
Apostolou, Dimitris ;
Hribernik, Karl ;
Mentzas, Gregoris .
ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: ARTIFICIAL INTELLIGENCE FOR SUSTAINABLE AND RESILIENT PRODUCTION SYSTEMS, APMS 2021, PT IV, 2021, 633 :303-310
[6]  
Campbell D., 1963, Experimental and quasi-experimental designs for research
[7]   Cognitive Manufacturing in Industry 4.0 toward Cognitive Load Reduction: A Conceptual Framework [J].
Carvalho, Adriana Ventura ;
Chouchene, Amal ;
Lima, Tania M. ;
Charrua-Santos, Fernando .
APPLIED SYSTEM INNOVATION, 2020, 3 (04) :1-14
[8]  
Casas WJP, 2014, J SCI IND RES INDIA, V73, P262
[9]   Multi-Modal Chatbot in Intelligent Manufacturing [J].
Chen, Tzu-Yu ;
Chiu, Yu-Ching ;
Bi, Nanyi ;
Tsai, Richard Tzong-Han .
IEEE ACCESS, 2021, 9 :82118-82129
[10]   Emerging trends: Smooth-talking machines [J].
Church, Kenneth Ward ;
Yue, Richard .
NATURAL LANGUAGE ENGINEERING, 2023, 29 (05) :1402-1410