Single image rain streaks removal: a review and an exploration

被引:26
|
作者
Wang, Hong [1 ,2 ]
Xie, Qi [1 ,2 ]
Wu, Yichen [1 ,2 ]
Zhao, Qian [1 ,2 ]
Meng, Deyu [1 ,2 ,3 ]
机构
[1] Xi An Jiao Tong Univ, Inst Informat & Syst Sci, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Shaanxi, Peoples R China
[3] Macau Univ Sci & Technol, Fac Informat Technol, Taipa, Macau, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Single image deraining; Conventional model; Deep learning; Encoder-decoder; Generalization capability; MODEL;
D O I
10.1007/s13042-020-01061-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, rain streaks removal from a single image has attracted much research attention to alleviate the degenerated performance of computer vision tasks implemented on rainy images. In this paper, we provide a thorough review for current single-image-based rain removal techniques, which can be mainly categorized into three classes: early filter-based, conventional prior-based, and recent deep learning-based approaches. Furthermore, inspired by the rationality of current deep learning-based methods and insightful characteristics underlying rain shapes, we build a specific coarse-to-fine deraining network architecture, which can finely deliver the rain structures and progressively removes rain streaks from the input image, accordingly. The superiority of the proposed network is substantiated by experiments implemented on synthetic and real rainy images both visually and quantitatively, as compared with comprehensive state-of-the-art methods along this line. Especially, it is verified that the proposed network possesses better generalization capability on real rainy images, implying its potential usefulness for this task.
引用
收藏
页码:853 / 872
页数:20
相关论文
共 50 条
  • [1] Single image rain streaks removal: a review and an exploration
    Hong Wang
    Qi Xie
    Yichen Wu
    Qian Zhao
    Deyu Meng
    International Journal of Machine Learning and Cybernetics, 2020, 11 : 853 - 872
  • [2] Rain Streaks Removal in Single Low-light Image
    Liu, Tong
    Wu, Zehao
    Li, Haowei
    Fu, Wenqi
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6228 - 6233
  • [3] Deep learning method for rain streaks removal from single image
    Wang, Meihua
    Chen, Lunbao
    Liang, Yun
    Huang, Han
    Cai, Ruichu
    JOURNAL OF ENGINEERING-JOE, 2020, 2020 (13): : 555 - 560
  • [4] Learning Bilevel Layer Priors for Single Image Rain Streaks Removal
    Mu, Pan
    Chen, Jian
    Liu, Risheng
    Fan, Xin
    Luo, Zhongxuan
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (02) : 307 - 311
  • [5] DEEP LAYER PRIOR OPTIMIZATION FOR SINGLE IMAGE RAIN STREAKS REMOVAL
    Liu, Risheng
    Jiang, Zhiying
    Ma, Long
    Fan, Xin
    Li, Haojie
    Luo, Zhongxuan
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1408 - 1412
  • [6] An Efficient Rain Streaks Detection and Removal for Single Image Using Hybridization of Rain Detection and Rain Removal Technique (HyDRA)
    Hassim, Raima
    Sulaiman, Hamzah Asyrani
    Bade, Abdullah
    ADVANCED SCIENCE LETTERS, 2018, 24 (02) : 1027 - 1031
  • [7] Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition
    Kang, Li-Wei
    Lin, Chia-Wen
    Fu, Yu-Hsiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) : 1742 - 1755
  • [8] RAIN STREAKS REMOVAL FOR SINGLE IMAGE VIA DIRECTIONAL TOTAL VARIATION REGULARIZATION
    Wang, Yugang
    Huang, Ting-Zhu
    Zhao, Xi-Le
    Deng, Liang-Jian
    Jiang, Tai-Xiang
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2801 - 2805
  • [9] Fast Removal of Rain Streaks From a Single image via a Shape Prior
    Luo, Yu
    Zhu, Jian
    Ling, Jie
    Wu, Enhua
    IEEE ACCESS, 2018, 6 : 60069 - 60078
  • [10] Rain streaks removal from single image based on texture constraint of background scene
    Du, Shuangli
    Liu, Yiguang
    Ye, Mao
    Zhao, Minghua
    Li, Zheng
    NEUROCOMPUTING, 2021, 419 : 224 - 238