FDD: a deep learning-based steel defect detectors

被引:29
作者
Akhyar, Fityanul [1 ]
Liu, Ying [2 ]
Hsu, Chao-Yung [3 ]
Shih, Timothy K. [4 ]
Lin, Chih-Yang [5 ]
机构
[1] Telkom Univ, Sch Elect Engn, Bandung 40257, West Java, Indonesia
[2] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[3] China Steel Corp, Automat & Instrumentat Syst Dev Sec, Kaohsiung 81233, Taiwan
[4] Natl Cent Univ, Dept Comp Sci & Informat Engn, Taoyuan 320317, Taiwan
[5] Natl Cent Univ, Dept Mech Engn, Taoyuan 320317, Taiwan
基金
美国国家科学基金会;
关键词
Steel defect detection; Deformable convolution; Deformable RoI pooling; Feature pyramid network; Guided anchoring; Region proposal network; SURFACE-DEFECTS; INTELLIGENCE; NETWORK; SYSTEM;
D O I
10.1007/s00170-023-11087-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Surface defects are a common issue that affects product quality in the industrial manufacturing process. Many companies put a lot of effort into developing automated inspection systems to handle this issue. In this work, we propose a novel deep learning-based surface defect inspection system called the forceful steel defect detector (FDD), especially for steel surface defect detection. Our model adopts the state-of-the-art cascade R-CNN as the baseline architecture and improves it with the deformable convolution and the deformable RoI pooling to adapt to the geometric shape of defects. Besides, our model adopts the guided anchoring region proposal to generate bounding boxes with higher accuracies. Moreover, to enrich the point of view of input images, we propose the random scaling and the ultimate scaling techniques in the training and inference process, respectively. The experimental studies on the Severstal steel dataset, NEU steel dataset, and DAGM dataset demonstrate that our proposed model effectively improved the detection accuracy in terms of the average recall (AR) and the mean average precision (mAP) compared to state-of-the-art defect detection methods. We expect our innovation to accelerate the automation of industrial manufacturing process by increasing the productivity and by sustaining high product qualities.
引用
收藏
页码:1093 / 1107
页数:15
相关论文
共 76 条
[1]  
Akhyar F., 2019, 2019 16 IEEE INT C A, P1, DOI DOI 10.1109/AVSS.2019.8909834
[2]   A Beneficial Dual Transformation Approach for Deep Learning Networks Used in Steel Surface Defect Detection [J].
Akhyar, Fityanul ;
Lin, Chih-Yang ;
Kathiresan, Gugan S. .
PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, :619-622
[3]  
Bochkovskiy Alexey, 2020, Arxiv Preprint Arxiv, DOI 10.48550/ARXIV.2004.10934
[4]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[5]   MegDet: A Large Mini-Batch Object Detector [J].
Peng, Chao ;
Xiao, Tete ;
Li, Zeming ;
Jiang, Yuning ;
Zhang, Xiangyu ;
Jia, Kai ;
Yu, Gang ;
Sun, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6181-6189
[6]   Hybrid Task Cascade for Instance Segmentation [J].
Chen, Kai ;
Pang, Jiangmiao ;
Wang, Jiaqi ;
Xiong, Yu ;
Li, Xiaoxiao ;
Sun, Shuyang ;
Feng, Wansen ;
Liu, Ziwei ;
Shi, Jianping ;
Ouyang, Wanli ;
Loy, Chen Change ;
Lin, Dahua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4969-4978
[7]   Two-Digit Phase-Coding Strategy for Fringe Projection Profilometry [J].
Chen, Xiangcheng ;
Wu, Jun ;
Fan, Ruimei ;
Liu, Qing ;
Xiao, Yongxin ;
Wang, Yuwei ;
Wang, Yajun .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[8]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[9]   TDD-net: a tiny defect detection network for printed circuit boards [J].
Ding, Runwei ;
Dai, Linhui ;
Li, Guangpeng ;
Liu, Hong .
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2019, 4 (02) :110-116
[10]   PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection [J].
Dong, Hongwen ;
Song, Kechen ;
He, Yu ;
Xu, Jing ;
Yan, Yunhui ;
Meng, Qinggang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (12) :7448-7458