LRP-net: A lightweight recursive pyramid network for single image deraining

被引:5
作者
Bi Xiaojun [1 ]
Chen Zheng [2 ]
Yue Jianyu [2 ]
Wang Haibo [3 ]
机构
[1] Minzu Univ China, Sch Informat Engn, Beijing, Peoples R China
[2] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin, Peoples R China
[3] BeiHang Univ, HeFei Innovat Res Inst, Hefei, Anhui, Peoples R China
关键词
Single image deraining; Lightweight neural networks; Multi-scale; Recursive deraining mechanism; Feature fusion; REMOVAL; RAIN;
D O I
10.1016/j.neucom.2022.03.035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image deraining, as a low-level computer vision task, has been drawn extensive attention in recent years. Rain streaks can degrade subjective visibility quality, meanwhile, bring significant difficulties to subsequent high-level computer vision tasks such as object detection. Nowadays, deep-learning based methods, specifically Convolutional Neural Networks (CNN) based ones are adopted to remove the rain streaks and become the state-of-the-art. However, existing popular deep-networks have complicated branches and numerous layers, which strengthen the ability of removing rain streaks and result in high memory and computational cost inevitably. This restricts many applications in real-time and limited computation resource scene, especially on mobile or edge devices. To handle this issue, this paper proposes a novel Lightweight Recursive Pyramid network (LRP-Net) with a small number of parameters for single image deraining. To begin with, we propose a novel Lightweight Pyramid Deraining (LPD) block which consists of a multi-scale pyramid convolution for sufficient feature extraction and a pointwise convolution for feature fusion. Meanwhile, we also design a novel group convolution strategy in LPD for the sake of remarkable parameter reduction. Secondly, we combine a recursive deraining mechanism, a critical component that serves as a feature fusion iterator to construct our LRPNet a powerful and lightweight multi-stage model. In the benefit of the combination between the LPD block and recursive mechanism, the total number of parameters in LRP-Net is only 130 k, which is nearly a 40-reduction compared with the latest state-of-the-art models. The extensive experiments demonstrate the superiority of LRP-Net in both quantitative assessments and visual quality.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:181 / 192
页数:12
相关论文
共 43 条
[1]   Analysis of Rain and Snow in Frequency Space [J].
Barnum, Peter C. ;
Narasimhan, Srinivasa ;
Kanade, Takeo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 86 (2-3) :256-274
[2]   Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks [J].
Bossu, Jeremie ;
Hautiere, Nicolas ;
Tarel, Jean-Philippe .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :348-367
[3]  
Chang ] yi, 2017, TRANSFORMED LOW RANK, P1735, DOI [10.1109/ICCV.2017.191, DOI 10.1109/ICCV.2017.191]
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Chen Y.-L., 2013, GEN LOW RANK APPEARA, P1968, DOI [10.1109/ICCV.2013.247, DOI 10.1109/ICCV.2013.247]
[6]   SPGNet: Semantic Prediction Guidance for Scene Parsing [J].
Cheng, Bowen ;
Chen, Liang-Chieh ;
Wei, Yunchao ;
Zhu, Yukun ;
Huang, Zilong ;
Xiong, Jinjun ;
Huang, Thomas S. ;
Hwu, Wen-Mei ;
Shi, Honghui .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5217-5227
[7]   Detail-recovery Image Deraining via Context Aggregation Networks [J].
Deng, Sen ;
Wei, Mingqiang ;
Wang, Jun ;
Feng, Yidan ;
Liang, Luming ;
Xie, Haoran ;
Wang, Fu Lee ;
Wang, Meng .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14548-14557
[8]   Residual-Guide Network for Single Image Deraining [J].
Fan, Zhiwen ;
Wu, Huafeng ;
Fu, Xueyang ;
Huang, Yue ;
Ding, Xinghao .
PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, :1751-1759
[9]   Lightweight Pyramid Networks for Image Deraining [J].
Fu, Xueyang ;
Liang, Borong ;
Huang, Yue ;
Ding, Xinghao ;
Paisley, John .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) :1794-1807
[10]   Removing rain from single images via a deep detail network [J].
Fu, Xueyang ;
Huang, Jiabin ;
Zeng, Delu ;
Huang, Yue ;
Ding, Xinghao ;
Paisley, John .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1715-1723