An intelligent monitoring system for robotic milling process based on transfer learning and digital twin

被引:2
作者
Zhu, Zhaoju [1 ]
Zhu, Wenrong [1 ]
Huang, Jianwei [1 ]
He, Bingwei [1 ]
机构
[1] Fuzhou Univ, Sch Mech Engn & Automat, Fuzhou 350116, Fujian Province, Peoples R China
关键词
Digital twin; Transfer learning; Process simulation; Tool wear;
D O I
10.1016/j.jmsy.2024.12.009
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Robotic milling is becoming widely used in aerospace and auto manufacturing due to its high flexibility and strong adaptability. However, the practical challenges including complex and time-consuming robot trajectory planning, insufficient monitoring, and lacking three-dimensional visualization limits its further application. To address these challenges, an intelligent monitoring system for robotic milling process based on transfer learning and digital twin was proposed and developed in this paper. Firstly, the fundamental framework of this system was conducted based on a five-dimensional digital twin model for motion simulation, visualization, and tool wear prediction during the robotic milling process. Secondly, the parsing algorithm converting NC code to robot's machining trajectory and material removal algorithm based on bounding box and mesh deformation were proposed for robotic dynamic milling simulation. Thirdly, a novel transfer learning algorithm named CNN-LSTM-TrAdaBoost.R2 was developed by integrating CNN-LSTM with TrAdaBoost.R2 for automated feature extraction and real-time prediction of tool wear. Finally, the effective and accuracy of tool wear prediction algorithm is verified by ablation experiment and the robotic milling simulation is validated by real milling experiment, as well. The results indicate that the proposed monitoring system for robotic milling process demonstrates great virtual-real mapping. It can offer new insights and technical support for constructing sophisticated digital twin frameworks and enhancing operational monitoring in manufacturing systems.
引用
收藏
页码:433 / 443
页数:11
相关论文
共 50 条
[21]   An online monitoring method of milling cutter wear condition driven by digital twin [J].
Zi, Xintian ;
Gao, Shangshang ;
Xie, Yang .
SCIENTIFIC REPORTS, 2024, 14 (01)
[22]   Digital Twin Robotic System With Continuous Learning for Grasp Detection in Variable Scenes [J].
Ren, Lei ;
Dong, Jiabao ;
Huang, Di ;
Lu, Jinhu .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (07) :7653-7663
[23]   BUILDING A CLOUD-BASED DIGITAL TWIN FOR A ROBOTIC ASSEMBLY SYSTEM [J].
Bin Touhid, Md Tahmid ;
Marne, Mrunal ;
Oskroba, Theodore ;
Mirahmadi, Sayed Amirhossein ;
Zhu, Enshen ;
Mahrabian, Alireza ;
Defersha, Fantahun ;
Yang, Sheng .
PROCEEDINGS OF ASME 2023 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2023, VOL 2, 2023,
[24]   Automated and Intelligent System for Monitoring Swimming Pool Safety Based on the IoT and Transfer Learning [J].
Alotaibi, Aziz .
ELECTRONICS, 2020, 9 (12) :1-13
[25]   Research on Intelligent Operation and Maintenance System of Battery Based on Digital Twin [J].
Cheng, Gang ;
Wei, Wei ;
Liu, Zihan .
2021 2ND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND INTELLIGENT CONTROL (ICCEIC 2021), 2021, :154-157
[26]   A digital twin system for centrifugal pump fault diagnosis driven by transfer learning based on graph convolutional neural networks [J].
Xu, Zifeng ;
Wang, Zhe ;
Gao, Chaojia ;
Zhang, Keqi ;
Lv, Jie ;
Wang, Jie ;
Liu, Lilan .
COMPUTERS IN INDUSTRY, 2024, 163
[27]   A multi-robot monitoring system based on digital twin [J].
Zong, Xueyan ;
Luan, Yan ;
Wang, Hongliang ;
Li, Shu .
PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE OF INFORMATION AND COMMUNICATION TECHNOLOGY, 2021, 183 :94-99
[28]   Digital Twin Model of Photovoltaic Power Generation Prediction Based on LSTM and Transfer Learning [J].
Shi K. ;
Zhang D. ;
Han X. ;
Xie Z. .
Dianwang Jishu/Power System Technology, 2022, 46 (04) :1363-1371
[29]   Digital Twin-Based Transfer Learning for Collaborative Robot Systems: A Proof of Concept [J].
Roongpraiwan, Supat ;
Li, Zongdian ;
Pourghasemian, Mohsen ;
Gacanin, Haris ;
Sakaguchi, Kei .
38TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN 2024, 2024, :593-598
[30]   Online Monitoring Method for NC Milling Tool Wear by Digital Twin-driven [J].
Li C. ;
Sun X. ;
Hou X. ;
Zhao X. ;
Wu S. .
Zhongguo Jixie Gongcheng/China Mechanical Engineering, 2022, 33 (01) :78-87