SPEED:Semantic Prior and Extremely Efficient Dilated Convolution Network for Real-Time Metal Surface Defects Detection

被引:33
作者
Guo, Bingyang [1 ]
Wang, Yuting [1 ]
Zhen, Shi [1 ]
Yu, Ruiyun [1 ]
Su, Zhan [1 ]
机构
[1] Northeastern Univ, Sch Software Engn, Shenyang 110000, Peoples R China
基金
中国国家自然科学基金;
关键词
Dilated convolution; real-time semantic segmentation; surface defect detection;
D O I
10.1109/TII.2022.3233674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automatic defect detection on the metal surface is a vital task for product inspection in industrial assembly lines or production processes. Owing to miscellaneous patterns of defects, interclass similarity, intraclass difference, and fewer defect samples, achieving accurate and automatic detection remains a big challenge. What is more, since the rising demand for production efficiency, real-time detection is increasingly desirable. This article proposes a semantic prior and extremely efficient dilated convolution network, named SPEED, for pixel-wise detection on the metal surface, which aims to address the aforementioned issues. The architecture of SPEED involves the following: 1) a semantic prior (SP) branch, with shallow layer and prior mapping module to capture low-level details; and 2) an extremely efficient dilation (EED) branch, with lightweight bottleneck to obtain high-level context. Furthermore, an aggregation module is designed to fuse both types of feature representation. Additionally, different level features of bottleneck are fused to improve the segmentation performance. Experimental results on three metal surface defect datasets indicate that the proposed method outperforms the state-of-the-art approaches in terms of the mean intersection of union, model parameters, FLOPs, and FPS. More specifically, SPEED achieves 92.34% mIoU on NEU-Seg, 88.65% mIoU on Severstal Strip Steel, and 63.91% mIoU on MT Defect.
引用
收藏
页码:11380 / 11390
页数:11
相关论文
共 34 条
[1]   Attention-based generative adversarial network with internal damage segmentation using thermography [J].
Ali, Rahmat ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2022, 141
[2]   Subsurface damage detection of a steel bridge using deep learning and uncooled micro-bolometer [J].
Ali, Rahmat ;
Cha, Young-Jin .
CONSTRUCTION AND BUILDING MATERIALS, 2019, 226 :376-387
[3]  
[Anonymous], 2016, ENET DEEP NEURAL NET
[4]   Inspection of Imprint Defects in Stamped Metal Surfaces Using Deep Learning and Tracking [J].
Block, Sylvio Biasuz ;
da Silva, Ricardo Dutra ;
Dorini, Leyza Baldo ;
Minetto, Rodrigo .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (05) :4498-4507
[5]   A Pixel-Level Segmentation Convolutional Neural Network Based on Deep Feature Fusion for Surface Defect Detection [J].
Cao, Jingang ;
Yang, Guotian ;
Yang, Xiyun .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[6]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[7]   NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naive Bayes Data Fusion [J].
Chen, Fu-Chen ;
Jahanshahi, Mohammad R. .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (05) :4392-4400
[8]   SDDNet: Real-Time Crack Segmentation [J].
Choi, Wooram ;
Cha, Young-Jin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) :8016-8025
[9]   PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection [J].
Dong, Hongwen ;
Song, Kechen ;
He, Yu ;
Xu, Jing ;
Yan, Yunhui ;
Meng, Qinggang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (12) :7448-7458
[10]   Rethinking BiSeNet For Real-time Semantic Segmentation [J].
Fan, Mingyuan ;
Lai, Shenqi ;
Huang, Junshi ;
Wei, Xiaoming ;
Chai, Zhenhua ;
Luo, Junfeng ;
Wei, Xiaolin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :9711-9720