SharpGAN: Dynamic Scene Deblurring Method for Smart Ship Based on Receptive Field Block and Generative Adversarial Networks

被引:19
作者
Feng, Hui [1 ,2 ]
Guo, Jundong [1 ,2 ]
Xu, Haixiang [1 ,2 ]
Ge, Shuzhi Sam [3 ]
机构
[1] Wuhan Univ Technol, Key Lab High Performance Ship Technol, Minist Educ, Wuhan 430063, Peoples R China
[2] Wuhan Univ Technol, Sch Transportat, Wuhan 430063, Peoples R China
[3] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
关键词
image deblurring; object detection; smart ship; GAN;
D O I
10.3390/s21113641
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Complex marine environment has an adverse effect on the object detection algorithm based on the vision sensor for the smart ship sailing at sea. In order to eliminate the motion blur in the images during the navigation of the smart ship and ensure safety, we propose SharpGAN, a new image deblurring method based on the generative adversarial network (GAN). First of all, we introduce the receptive field block net (RFBNet) to the deblurring network to enhance the network's ability to extract blurred image features. Secondly, we propose a feature loss that combines different levels of image features to guide the network to perform higher-quality deblurring and improve the feature similarity between the restored images and the sharp images. Besides, we use the lightweight RFB-s module to significantly improve the real-time performance of the deblurring network. Compared with the existing deblurring methods, the proposed method not only has better deblurring performance in subjective visual effects and objective evaluation criteria, but also has higher deblurring efficiency. Finally, the experimental results reveal that the SharpGAN has a high correlation with the deblurring methods based on the physical model.
引用
收藏
页数:18
相关论文
共 34 条
[1]  
[Anonymous], SINGAPORE MARITIME D
[2]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[3]  
Fergus R., P ANN C NEURAL INFOR, P1033
[4]   Removing camera shake from a single photograph [J].
Fergus, Rob ;
Singh, Barun ;
Hertzmann, Aaron ;
Roweis, Sam T. ;
Freeman, William T. .
ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03) :787-794
[5]   From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blur [J].
Gong, Dong ;
Yang, Jie ;
Liu, Lingqiao ;
Zhang, Yanning ;
Reid, Ian ;
Shen, Chunhua ;
van den Hengel, Anton ;
Shi, Qinfeng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3806-3815
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   IMAGE RESTORATION BY METHOD OF LEAST SQUARES [J].
HELSTROM, CW .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1967, 57 (03) :297-&
[8]  
Gulrajani I, 2017, ADV NEUR IN, V30
[9]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[10]   DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better [J].
Kupyn, Orest ;
Martyniuk, Tetiana ;
Wu, Junru ;
Wang, Zhangyang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8877-8886