Digital twin-enabled multi-robot system for collaborative assembly of unorganized parts

被引:4
作者
Oo, Kyaw Htet [1 ]
Koomsap, Pisut [1 ]
Ayutthaya, Duangthida Hussadintorn Na [1 ]
机构
[1] Asian Inst Technol, Dept Ind Syst Engn, Pathum Thani 12120, Thailand
关键词
Digital twin; Multi-robot system; Assembly; Collaboration; Virtual reality; Unorganized parts;
D O I
10.1016/j.jii.2024.100764
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Agility and flexibility in production are essential to meet the challenge of the demand surge for diverse personalized products that come in small volumes. Automatic assembly is one critical process at stake due to the inherent complexity of the number of parts, their shapes, and the randomness of their initial orientations and positions upon arrival at the station. This research introduces a digital twin framework with an information integration layer designed to enhance the flexibility and efficiency of multi-robot operating systems by collaborating with operator skills, addressing the demand for personalized production. The digital twin model allows operators to remotely implant their skills to oversee the assembly process and to control and train the multi-robot operations through an immersive virtual reality interface upon the arrival of new orders without disrupting the current operations of the physical system. The virtual world allows simulations of the algorithms for collisionfree movement and task optimization among multiple robots. Besides, image processing techniques are employed to identify parts arriving in random orientations at the station, providing flexibility during the physical assembly phase. According to the investigation, integrating virtual reality and real-time control challenges data processing and requires robust networking and computational resources. This study contributes to multi-robot operations by providing a scalable and adaptable solution by collaborating with operator skills that enhance both the planning and execution phases of complex assembly processes to new product specifications and changes in design. The methodology presented is foreseen to apply to other manufacturing processes.
引用
收藏
页数:25
相关论文
共 46 条
[21]   Scattering or Pushing for Object Singulation in Cluttered Environment: Case Study with Soma Cube [J].
Khan, Muhammad Umair Ahmad ;
Imran, Abid ;
Kim, Sanghwa ;
Hwang, Hyunho ;
Lee, Ji Yeong ;
Lee, Sungon ;
Yi, Byung-Ju .
APPLIED SCIENCES-BASEL, 2020, 10 (24) :1-19
[22]  
Kim G.S., 2023, J. Korean Soc. Ind. Conver., V26, P545, DOI [10.21289/KSIC.2023.26.4.545, DOI 10.21289/KSIC.2023.26.4.545]
[23]   Digital twin-driven deep reinforcement learning for adaptive task allocation in robotic construction [J].
Lee, Dongmin ;
Lee, SangHyun ;
Masoud, Neda ;
Krishnan, M. S. ;
Li, Victor C. .
ADVANCED ENGINEERING INFORMATICS, 2022, 53
[24]   Multisource Model-Driven Digital Twin System of Robotic Assembly [J].
Li, Xin ;
He, Bin ;
Zhou, Yanmin ;
Li, Gang .
IEEE SYSTEMS JOURNAL, 2021, 15 (01) :114-123
[25]   Digital twin model-based smart assembly strategy design and precision evaluation for PCB kit-box build [J].
Li, Xurui ;
Liu, Guangshuai ;
Sun, Si ;
Yi, Wenyu ;
Li, Bailin .
JOURNAL OF MANUFACTURING SYSTEMS, 2023, 71 :206-223
[26]   A digital twin-based sim-to-real transfer for deep reinforcement learning-enabled industrial robot grasping [J].
Liu, Yongkui ;
Xu, He ;
Liu, Ding ;
Wang, Lihui .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 78
[27]   Building Skill Learning Systems for Robotics [J].
Lutter, Michael ;
Clever, Debora ;
Kirsten, Rene ;
Listmann, Kim ;
Peters, Jan .
2021 IEEE 17TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2021, :1878-1883
[28]  
Ma SH, 2019, PROCEEDINGS OF 2019 14TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), P369, DOI [10.1109/icemi46757.2019.9101563, 10.1109/ICEMI46757.2019.9101563]
[29]   Integration of Deep Learning and Collaborative Robot for Assembly Tasks [J].
Mendez, Enrico ;
Ochoa, Oscar ;
Olivera-Guzman, David ;
Soto-Herrera, Victor Hugo ;
Luna-Sanchez, Jose Alfredo ;
Lucas-Dophe, Carolina ;
Lugo-del-Real, Eloina ;
Ayala-Garcia, Ivo Neftali ;
Perez, Miriam Alvarado ;
Gonzalez, Alejandro .
APPLIED SCIENCES-BASEL, 2024, 14 (02)
[30]   Digital Twin-Driven Control Method for Robotic Automatic Assembly System [J].
Meng, Shaohua ;
Tang, Shaolin ;
Zhu, Yahong ;
Chen, Changyu .
2ND INTERNATIONAL CONFERENCE ON FRONTIERS OF MATERIALS SYNTHESIS AND PROCESSING, 2019, 493