Digital twin-enabled multi-robot system for collaborative assembly of unorganized parts

被引:4
作者
Oo, Kyaw Htet [1 ]
Koomsap, Pisut [1 ]
Ayutthaya, Duangthida Hussadintorn Na [1 ]
机构
[1] Asian Inst Technol, Dept Ind Syst Engn, Pathum Thani 12120, Thailand
关键词
Digital twin; Multi-robot system; Assembly; Collaboration; Virtual reality; Unorganized parts;
D O I
10.1016/j.jii.2024.100764
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Agility and flexibility in production are essential to meet the challenge of the demand surge for diverse personalized products that come in small volumes. Automatic assembly is one critical process at stake due to the inherent complexity of the number of parts, their shapes, and the randomness of their initial orientations and positions upon arrival at the station. This research introduces a digital twin framework with an information integration layer designed to enhance the flexibility and efficiency of multi-robot operating systems by collaborating with operator skills, addressing the demand for personalized production. The digital twin model allows operators to remotely implant their skills to oversee the assembly process and to control and train the multi-robot operations through an immersive virtual reality interface upon the arrival of new orders without disrupting the current operations of the physical system. The virtual world allows simulations of the algorithms for collisionfree movement and task optimization among multiple robots. Besides, image processing techniques are employed to identify parts arriving in random orientations at the station, providing flexibility during the physical assembly phase. According to the investigation, integrating virtual reality and real-time control challenges data processing and requires robust networking and computational resources. This study contributes to multi-robot operations by providing a scalable and adaptable solution by collaborating with operator skills that enhance both the planning and execution phases of complex assembly processes to new product specifications and changes in design. The methodology presented is foreseen to apply to other manufacturing processes.
引用
收藏
页数:25
相关论文
共 46 条
[1]   Integrated Motion Planning for Assembly Task with Part Manipulation Using Re-Grasping [J].
Ali, Ahmad ;
Lee, Ji Yeong .
APPLIED SCIENCES-BASEL, 2020, 10 (03)
[2]   Robotic assembly of timber joints using reinforcement learning [J].
Apolinarska, Aleksandra Anna ;
Pacher, Matteo ;
Li, Hui ;
Cote, Nicholas ;
Pastrana, Rafael ;
Gramazio, Fabio ;
Kohler, Matthias .
AUTOMATION IN CONSTRUCTION, 2021, 125
[3]   Customer's PIE for experiencescape design [J].
Ayutthaya, Duangthida Hussadintorn Na ;
Koomsap, Pisut .
JOURNAL OF ENGINEERING DESIGN, 2024, 35 (01) :22-53
[4]   Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep-Reinforcement-Learning Approach [J].
Beltran-Hernandez, Cristian C. ;
Petit, Damien ;
Ramirez-Alpizar, Ixchel G. ;
Harada, Kensuke .
APPLIED SCIENCES-BASEL, 2020, 10 (19) :1-17
[5]  
Brown K, 2020, IEEE INT CONF ROBOT, P441, DOI [10.1109/icra40945.2020.9197527, 10.1109/ICRA40945.2020.9197527]
[6]   Action Sequencing Using Visual Permutations [J].
Burke, Michael ;
Subr, Kartic ;
Ramamoorthy, Subramanian .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) :1745-1752
[7]  
Cebulla Alexander, 2023, 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), P1, DOI 10.1109/CASE56687.2023.10260328
[8]   Planning to Build Soma Blocks Using a Dual-arm Robot [J].
Chen, Hao ;
Wan, Weiwei ;
Harada, Kensuke .
IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL 2021, 2021,
[9]   Planning to Build Block Structures With Unstable Intermediate States Using Two Manipulators [J].
Chen, Hao ;
Wan, Weiwei ;
Koyama, Keisuke ;
Harada, Kensuke .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) :3777-3793
[10]   Multi-robot grasp planning for sequential assembly operations [J].
Dogar, Mehmet ;
Spielberg, Andrew ;
Baker, Stuart ;
Rus, Daniela .
AUTONOMOUS ROBOTS, 2019, 43 (03) :649-664