Detection of Manufacturing Defects in Steel Using Deep Learning With Explainable Artificial Intelligence

被引:8
作者
Aboulhosn, Zeina [1 ]
Musamih, Ahmad [2 ]
Salah, Khaled [3 ]
Jayaraman, Raja [2 ]
Omar, Mohammed [2 ]
Aung, Zeyar [1 ]
机构
[1] Khalifa Univ Sci & Technol, Dept Comp Sci, Abu Dhabi, U Arab Emirates
[2] Khalifa Univ Sci & Technol, Dept Management Sci & Engn, Abu Dhabi, U Arab Emirates
[3] Khalifa Univ Sci & Technol, Dept Comp & Commun Engn, Abu Dhabi, U Arab Emirates
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Steel; Manufacturing; Data models; Feature extraction; Predictive models; Defect detection; Deep learning; Convolutional neural networks; Fourth Industrial Revolution; data augmentation; explainability; industry; 4.0; steel defect detection;
D O I
10.1109/ACCESS.2024.3430113
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Guaranteeing steel quality is a crucial step in the steel manufacturing process. Many manufacturing industries still resort to manual visual inspection, which is inefficient and time-consuming. Industries have not fully adopted automated visual inspection due to inaccuracies, the variability of real-world manufacturing environments, and a lack of familiarity with the decisions output by the automated technology. Nonetheless, the implementation of automated defect detection systems can substantially enhance the quality of the end product. In particular, Convolutional Neural Networks (CNNs) have demonstrated exceptional abilities in image classification and segmentation tasks. There is still significant room for improvement in terms of the detection and localization accuracy, the robustness of the algorithms, and their practicality of use. This paper employs and evaluates different semantic segmentation approaches with U-Net and Feature Pyramid Network (FPN) architecture utilizing different CNN backbones. Additionally, the study enhances the model's robustness by utilizing various data augmentation techniques. Moreover, the study incorporates Explainable Artificial Intelligence (XAI) to provide insights into the decision-making processes of deep neural networks, bridging the gap in understanding. The contributions of this work are in improving the practicality, interpretability, and robustness of CNN-based algorithms for steel surface defect detection and segmentation.
引用
收藏
页码:99240 / 99257
页数:18
相关论文
共 39 条
[1]   Deep Learning-Based Defect Detection System in Steel Sheet Surfaces [J].
Amin, Didarul ;
Akhter, Shamim .
2020 IEEE REGION 10 SYMPOSIUM (TENSYMP) - TECHNOLOGY FOR IMPACTFUL SUSTAINABLE DEVELOPMENT, 2020, :444-448
[2]   Influence of the Mechanical and Corrosion Defects on the Strength of Thermally Hardened Reinforcement of 35GS Steel [J].
Blikhars'kyi, Z. Ya. ;
Obukh, Yu. V. .
MATERIALS SCIENCE, 2018, 54 (02) :273-278
[3]   Synthetic Data Generation for Steel Defect Detection and Classification Using Deep Learning [J].
Boikov, Aleksei ;
Payor, Vladimir ;
Savelev, Roman ;
Kolesnikov, Alexandr .
SYMMETRY-BASEL, 2021, 13 (07)
[4]  
Bovik A. C., 2010, Handbook of Image and Video Processing
[5]  
Caleb P, 2000, KES'2000: FOURTH INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED INTELLIGENT ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, VOLS 1 AND 2, PROCEEDINGS, P103, DOI 10.1109/KES.2000.885769
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]   Multi-class classification method using twin support vector machines with multi-information for steel surface defects [J].
Chu, Maoxiang ;
Liu, Xiaoping ;
Gong, Rongfen ;
Liu, Liming .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2018, 176 :108-118
[8]  
Dosilovic FK, 2018, 2018 41ST INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), P210, DOI 10.23919/MIPRO.2018.8400040
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   The Duo of Artificial Intelligence and Big Data for Industry 4.0: Applications, Techniques, Challenges, and Future Research Directions [J].
Jagatheesaperumal, Senthil Kumar ;
Rahouti, Mohamed ;
Ahmad, Kashif ;
Al-Fuqaha, Ala ;
Guizani, Mohsen .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (15) :12861-12885