Research on Rain Removal Method for Single Image Based on Multi-channel and Multi-scale CNN

被引:6
作者
Liu Changyuan [1 ]
Wang Qi [1 ]
Bi Xiaojun [2 ]
机构
[1] Harbin Univ Sci & Technol, Sch Elect & Elect Engn, Harbin 150000, Peoples R China
[2] Harbin Engn Univ, Sch Informat & Commun Engn, Harbin 150000, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Dilated convolution; Image decomposition; Multi-scale feature extraction; NETWORK;
D O I
10.11999/JEIT190755
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Rainy days and other severe weather will seriously affect the image quality, thus affecting the performance of vision processing algorithms. In order to improve the imaging quality of rain images, a rain removal algorithm based on multi-channel multi-scale convolution neural network to extract rain line features is proposed. Firstly, the rain images are decomposed by wavelet threshold-guided bilateral filtering to obtain high-frequency rain line images and low-frequency background images with high contour preservation. Then, in order to make the rain line information in the high-frequency part of the image more obvious and reduce the background misjudgment in the high-frequency image during the rain line feature learning, the obtained high-frequency rain line image is passed through a filter again to obtain a higher-frequency rain line image with reduced background information and enhanced rain line information. Secondly, in view of the large amount of raindrop imprint left on the low-frequency background image, it is proposed to send the low-frequency background image and the higher-frequency rain line image together into the convolution neural network for feature learning, in which multi-scale feature information is extracted from the image, finally, a more complete restoration image with rain line removal is obtained. At the same time, when constructing the network model, hole convolution is used instead of standard convolution to extract the feature information of the image, thus obtaining richer image features and improving the rain removal performance of the algorithm. From the experimental results, after removing rain, the image is clear and the detail retention is high.
引用
收藏
页码:2285 / 2292
页数:8
相关论文
共 18 条
[1]   Analysis of Rain and Snow in Frequency Space [J].
Barnum, Peter C. ;
Narasimhan, Srinivasa ;
Kanade, Takeo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 86 (2-3) :256-274
[2]   Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework [J].
Chen, Jie ;
Tan, Cheen-Hau ;
Hou, Junhui ;
Chau, Lap-Pui ;
Li, He .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6286-6295
[3]   Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal [J].
Fu, Xueyang ;
Huang, Jiabin ;
Ding, Xinghao ;
Liao, Yinghao ;
Paisley, John .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (06) :2944-2956
[4]  
Garg K, 2004, PROC CVPR IEEE, P528
[5]   Aircraft Detection Method Based on Deep Convolutional Neural Network for Remote Sensing Images [J].
Guo Zhi ;
Song Ping ;
Zhang Yi ;
Yan Menglong ;
Sun Xian ;
Sun Hao .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (11) :2684-2690
[6]   Self-Learning Based Image Decomposition With Applications to Single Image Denoising [J].
Huang, De-An ;
Kang, Li-Wei ;
Wang, Yu-Chiang Frank ;
Lin, Chia-Wen .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (01) :83-93
[7]   Scope of validity of PSNR in image/video quality assessment [J].
Huynh-Thu, Q. ;
Ghanbari, M. .
ELECTRONICS LETTERS, 2008, 44 (13) :800-U35
[8]   Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition [J].
Kang, Li-Wei ;
Lin, Chia-Wen ;
Fu, Yu-Hsiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) :1742-1755
[9]  
Kim JH, 2013, IEEE IMAGE PROC, P914, DOI 10.1109/ICIP.2013.6738189
[10]   Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos [J].
Liu, Jiaying ;
Yang, Wenhan ;
Yang, Shuai ;
Guo, Zongming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3233-3242