Single image rain streaks removal: a review and an exploration

被引:26
|
作者
Wang, Hong [1 ,2 ]
Xie, Qi [1 ,2 ]
Wu, Yichen [1 ,2 ]
Zhao, Qian [1 ,2 ]
Meng, Deyu [1 ,2 ,3 ]
机构
[1] Xi An Jiao Tong Univ, Inst Informat & Syst Sci, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Shaanxi, Peoples R China
[3] Macau Univ Sci & Technol, Fac Informat Technol, Taipa, Macau, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Single image deraining; Conventional model; Deep learning; Encoder-decoder; Generalization capability; MODEL;
D O I
10.1007/s13042-020-01061-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, rain streaks removal from a single image has attracted much research attention to alleviate the degenerated performance of computer vision tasks implemented on rainy images. In this paper, we provide a thorough review for current single-image-based rain removal techniques, which can be mainly categorized into three classes: early filter-based, conventional prior-based, and recent deep learning-based approaches. Furthermore, inspired by the rationality of current deep learning-based methods and insightful characteristics underlying rain shapes, we build a specific coarse-to-fine deraining network architecture, which can finely deliver the rain structures and progressively removes rain streaks from the input image, accordingly. The superiority of the proposed network is substantiated by experiments implemented on synthetic and real rainy images both visually and quantitatively, as compared with comprehensive state-of-the-art methods along this line. Especially, it is verified that the proposed network possesses better generalization capability on real rainy images, implying its potential usefulness for this task.
引用
收藏
页码:853 / 872
页数:20
相关论文
共 50 条
  • [41] Multi-Scale Attention Generative Adversarial Network for Single Image Rain Removal
    Pattern Recognition and Image Analysis, 2022, 32 : 436 - 447
  • [42] DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removal
    Wang, Cong
    Xing, Xiaoying
    Wu, Yutong
    Su, Zhixun
    Chen, Junyang
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1643 - 1651
  • [43] Rain Streaks Removal in Images using Extended Generative Adversarial-based Deraining Framework
    Gogulamudi, Subbarao
    Mahalakshmi, V.
    Sreeram, Indraneel
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (04) : 679 - 690
  • [44] Not Just Streaks: Towards Ground Truth for Single Image Deraining
    Ba, Yunhao
    Zhang, Howard
    Yang, Ethan
    Suzuki, Akira
    Pfahnl, Arnold
    Chandrappa, Chethan Chinder
    de Melo, Celso M.
    You, Suya
    Soatto, Stefano
    Wong, Alex
    Kadambi, Achuta
    COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 : 723 - 740
  • [45] AI-GAN: Asynchronous interactive generative adversarial network for single image rain removal
    Jin, Xin
    Chen, Zhibo
    Li, Weiping
    PATTERN RECOGNITION, 2020, 100
  • [46] Wavelet Based Deep Recursive Pyramid Convolution Residual Network for Single Image Rain Removal
    Gong, Tian Tian
    Wang, Jun Sheng
    IEEE ACCESS, 2020, 8 : 195870 - 195882
  • [47] Single Image Rain Removal via Cascading Attention Aggregation Network on Challenging Weather Conditions
    Wang, Junsheng
    Huang, Xiang
    Gai, Shan
    IEEE ACCESS, 2019, 7 : 178848 - 178861
  • [48] Single image deraining using local rain distribution map
    Chen, Huasong
    Wu, Jing
    Xu, Zhenhua
    Feng, Qiansheng
    Fan, Yuanyuan
    Li, Zhenhua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 50349 - 50380
  • [49] Rain Removal from a Single Image Using Refined Inception ResNet v2
    Bijaylaxmi Das
    Ayan Saha
    Sudipta Mukhopadhyay
    Circuits, Systems, and Signal Processing, 2023, 42 : 3485 - 3508
  • [50] Learning Gated Non-Local Residual for Single-Image Rain Streak Removal
    Zhu, Lei
    Deng, Zijun
    Hu, Xiaowei
    Xie, Haoran
    Xu, Xuemiao
    Qin, Jing
    Heng, Pheng-Ann
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (06) : 2147 - 2159