A Real-Time Defect Detection Strategy for Additive Manufacturing Processes Based on Deep Learning and Machine Vision Technologies

被引:13
作者
Wang, Wei [1 ]
Wang, Peiren [1 ]
Zhang, Hanzhong [1 ]
Chen, Xiaoyi [1 ]
Wang, Guoqi [1 ]
Lu, Yang [1 ]
Chen, Min [2 ]
Liu, Haiyun [3 ]
Li, Ji [1 ]
机构
[1] Southeast Univ, Key Lab MEMS, Minist Educ, Nanjing 210096, Peoples R China
[2] Xian Jiaotong Liverpool Univ, Sch Adv Technol, Suzhou 215400, Peoples R China
[3] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
基金
中国国家自然科学基金;
关键词
additive manufacturing; defect detection; deep learning; machine vision;
D O I
10.3390/mi15010028
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Nowadays, additive manufacturing (AM) is advanced to deliver high-value end-use products rather than individual components. This evolution necessitates integrating multiple manufacturing processes to implement multi-material processing, much more complex structures, and the realization of end-user functionality. One significant product category that benefits from such advanced AM technologies is 3D microelectronics. However, the complexity of the entire manufacturing procedure and the various microstructures of 3D microelectronic products significantly intensified the risk of product failure due to fabrication defects. To respond to this challenge, this work presents a defect detection technology based on deep learning and machine vision for real-time monitoring of the AM fabrication process. We have proposed an enhanced YOLOv8 algorithm to train a defect detection model capable of identifying and evaluating defect images. To assess the feasibility of our approach, we took the extrusion 3D printing process as an application object and tailored a dataset comprising a total of 3550 images across four typical defect categories. Test results demonstrated that the improved YOLOv8 model achieved an impressive mean average precision (mAP50) of 91.7% at a frame rate of 71.9 frames per second.
引用
收藏
页数:14
相关论文
共 33 条
[1]  
[Anonymous], 2012, ISO 9712 2012
[2]  
[Anonymous], 3D Printing of Multilayered and Multimaterial Electronics: A Review-Goh-2021-Advanced Electronic Materials, DOI [10.1002/aelm.202100445, DOI 10.1002/AELM.202100445]
[3]  
[Anonymous], A Review of Research on Object Detection Based on Deep Learning, DOI [10.1088/1742-6596/1684/1/012028/meta, DOI 10.1088/1742-6596/1684/1/012028/META]
[4]   Object Detection: Custom Trained Models for Quality Monitoring of Fused Filament Fabrication Process [J].
Bakas, Georgios ;
Bei, Kyriaki ;
Skaltsas, Ioannis ;
Gkartzou, Eleni ;
Tsiokou, Vaia ;
Papatheodorou, Alexandra ;
Karatza, Anna ;
Koumoulos, Elias P. .
PROCESSES, 2022, 10 (10)
[5]   Design and printing of proprioceptive three-dimensional architected robotic metamaterials [J].
Cui, Huachen ;
Yao, Desheng ;
Hensleigh, Ryan ;
Lu, Haotian ;
Calderon, Ariel ;
Xu, Zhenpeng ;
Davaria, Sheyda ;
Wang, Zhen ;
Mercier, Patrick ;
Tarazaga, Pablo ;
Zheng, Xiaoyu .
SCIENCE, 2022, 376 (6599) :1287-+
[6]   YOLO-MBBi: PCB Surface Defect Detection Method Based on Enhanced YOLOv5 [J].
Du, Bowei ;
Wan, Fang ;
Lei, Guangbo ;
Xu, Li ;
Xu, Chengzhi ;
Xiong, Ying .
ELECTRONICS, 2023, 12 (13)
[7]   3D PRINTING Additive manufacturing of polymer-derived ceramics [J].
Eckel, Zak C. ;
Zhou, Chaoyin ;
Martin, John H. ;
Jacobsen, Alan J. ;
Carter, William B. ;
Schaedler, Tobias A. .
SCIENCE, 2016, 351 (6268) :58-62
[8]   Machine learning algorithms for defect detection in metal laser-based additive manufacturing: A review [J].
Fu, Yanzhou ;
Downey, Austin R. J. ;
Yuan, Lang ;
Zhang, Tianyu ;
Pratt, Avery ;
Balogun, Yunusa .
JOURNAL OF MANUFACTURING PROCESSES, 2022, 75 :693-710
[9]   Coordinate Attention for Efficient Mobile Network Design [J].
Hou, Qibin ;
Zhou, Daquan ;
Feng, Jiashi .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13708-13717
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]