Recursive attention collaboration network for single image de-raining

被引:1
作者
Li, Zhitong [1 ]
Li, Xiaodong [1 ]
Gong, Zhaozhe [1 ]
Yu, Zhensheng [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
convolutional neural network; deep learning; machine learning; vision; REMOVAL; MODEL;
D O I
10.1049/csy2.12115
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-image rain removal is an important problem in the field of computer vision aimed at recovering clean images from rainy images. In recent years, data-driven convolutional neural network (CNN)-based rain removal methods have achieved significant results, but most of them cannot fully focus on the contextual information in rain-containing images, which leads to the failure of recovering some of the background details of the images that have been corrupted due to the aggregation of rain streaks. With the success of Transformer-based models in the field of computer vision, global features can be easily acquired to better help recover details in the background of an image. However, Transformer-based models often require a large number of parameters during the training process, which makes the training process very difficult and makes it difficult to apply them to specific devices for execution in reality. The authors propose a Recursive Attention Collaboration Network, which consists of a recursive Swin-transformer block (STB) and a CNN-based feature fusion block. The authors designed the Recursively Integrate Transformer Block (RITB), which consists of several STBs recursively connected, that can effectively reduce the number of parameters of the model. The final part of the module can integrate the local information from the STBs. The authors also design the Feature Enhancement Block, which can better recover the details of the background information corrupted by rain streaks of different density shapes through the features passed from the RITB. Experiments show that the proposed network has an effective rain removal effect on both synthetic and real datasets and has fewer model parameters than other mainstream methods.
引用
收藏
页数:16
相关论文
共 49 条
  • [1] Robust Representation Learning with Feedback for Single Image Deraining
    Chen, Chenghao
    Li, Hao
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7738 - 7747
  • [2] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [3] Learning A Sparse Transformer Network for Effective Image Deraining
    Chen, Xiang
    Li, Hao
    Li, Mingqiang
    Pan, Jinshan
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5896 - 5905
  • [4] A Generalized Low-Rank Appearance Model for Spatio-Temporally Correlated Rain Streaks
    Chen, Yi-Lei
    Hsu, Chiou-Ting
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1968 - 1975
  • [5] Single image rain and snow removal via guided L0 smoothing filter
    Ding, Xinghao
    Chen, Liqin
    Zheng, Xianhui
    Huang, Yue
    Zeng, Delu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (05) : 2697 - 2712
  • [6] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [7] Successive Graph Convolutional Network for Image De-raining
    Fu, Xueyang
    Qi, Qi
    Zha, Zheng-Jun
    Ding, Xinghao
    Wu, Feng
    Paisley, John
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (05) : 1691 - 1711
  • [8] Lightweight Pyramid Networks for Image Deraining
    Fu, Xueyang
    Liang, Borong
    Huang, Yue
    Ding, Xinghao
    Paisley, John
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (06) : 1794 - 1807
  • [9] Removing rain from single images via a deep detail network
    Fu, Xueyang
    Huang, Jiabin
    Zeng, Delu
    Huang, Yue
    Ding, Xinghao
    Paisley, John
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1715 - 1723
  • [10] Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
    Fu, Xueyang
    Huang, Jiabin
    Ding, Xinghao
    Liao, Yinghao
    Paisley, John
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (06) : 2944 - 2956