Rain-Like Layer Removal From Hot-Rolled Steel Strip Based on Attentive Dual Residual Generative Adversarial Network

被引:9
作者
Luo, Qiwu [1 ]
He, Handong [1 ]
Liu, Kexin [1 ]
Yang, Chunhua [1 ]
Silven, Olli [2 ]
Liu, Li [3 ]
机构
[1] Cent South Univ, Sch Automat, Changsha 410083, Peoples R China
[2] Univ Oulu, Ctr Machine Vis & Signal Anal CMVS, Oulu 90014, Finland
[3] Natl Univ Def Technol, Coll Elect Sci, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Rain; Steel; Strips; Image restoration; Generative adversarial networks; Generators; Inspection; Automated visual inspection (AVI); generative adversarial network (GAN); hot-rolled steel strip; rain-like layer removal; DEFECT CLASSIFICATION; STREAKS REMOVAL; SURFACE;
D O I
10.1109/TIM.2023.3265761
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Rain-like layer removal from hot-rolled steel strip surface has been proven to be a workable measure for suppressing the false alarms frequently triggered in automated visual inspection (AVI) instruments. This article extends the scope of the "rain-like layer" from dispersed waterdrops to splashing water streaks and tiny white droplets. And a targeted method with both channel-wise and spatial-wise attention, namely attentive dual residual generative adversarial network (ADRGAN), is proposed. Meanwhile, a newly updated steel surface image dataset with typical natures of a "rain-like layer" gathered from an actual hot-rolling line, Steel_Rain, is opened for the first time. The comparison of experimental results between our proposed network and 11 prestigious networks shows that our ADRGAN-restored images are the closest to the ground-truth images on six public datasets, especially on the newly opened industrial dataset Steel_Rain; it yields the best scores of 56.8627 peak signal to noise ratio (PSNR), 0.9980 structural similarity index (SSIM), 0.134 mean-square error (MSE) and 0.006 learned perceptual image patch similarity (LPIPS). In the final verification test, the concept of rain-like layer removal has been proved to perform best in defect inspection, where four traditional defect detection algorithms are involved. And as expected, defect detection methods assisted by ADRGAN yield the minimum false alarms.
引用
收藏
页数:15
相关论文
共 51 条
[1]   EAGNet: Elementwise Attentive Gating Network-Based Single Image De-Raining With Rain Simplification [J].
Ahn, Namhyun ;
Jo, So Yeon ;
Kang, Suk-Ju .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) :608-620
[2]   Visual Depth Guided Color Image Rain Streaks Removal Using Sparse Coding [J].
Chen, Duan-Yu ;
Chen, Chien-Cheng ;
Kang, Li-Wei .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (08) :1430-1455
[3]   Detail-recovery Image Deraining via Context Aggregation Networks [J].
Deng, Sen ;
Wei, Mingqiang ;
Wang, Jun ;
Feng, Yidan ;
Liang, Luming ;
Xie, Haoran ;
Wang, Fu Lee ;
Wang, Meng .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14548-14557
[4]   PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection [J].
Dong, Hongwen ;
Song, Kechen ;
He, Yu ;
Xu, Jing ;
Yan, Yunhui ;
Meng, Qinggang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (12) :7448-7458
[5]   Conditional Variational Image Deraining [J].
Du, Yingjun ;
Xu, Jun ;
Zhen, Xiantong ;
Cheng, Ming-Ming ;
Shao, Ling .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6288-6301
[6]   Restoring An Image Taken Through a Window Covered with Dirt or Rain [J].
Eigen, David ;
Krishnan, Dilip ;
Fergus, Rob .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :633-640
[7]   Removing rain from single images via a deep detail network [J].
Fu, Xueyang ;
Huang, Jiabin ;
Zeng, Delu ;
Huang, Yue ;
Ding, Xinghao ;
Paisley, John .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1715-1723
[8]   Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal [J].
Fu, Xueyang ;
Huang, Jiabin ;
Ding, Xinghao ;
Liao, Yinghao ;
Paisley, John .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (06) :2944-2956
[9]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[10]   Automatic Defect Detection on Hot-Rolled Flat Steel Products [J].
Ghorai, Santanu ;
Mukherjee, Anirban ;
Gangadaran, M. ;
Dutta, Pranab K. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2013, 62 (03) :612-621