Scale-Space Feature Recalibration Network for Single Image Deraining

被引:3
|
作者
Li, Pengpeng [1 ]
Jin, Jiyu [1 ]
Jin, Guiyue [1 ]
Fan, Lei [1 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
关键词
image deraining; multi-scale; attention recalibration; feature fusion; MODEL;
D O I
10.3390/s22186823
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Progressive Hybrid-Modulated Network for Single Image Deraining
    Yu, Xiaoyuan
    Zhang, Guidong
    Tan, Fei
    Li, Fengguo
    Xie, Wei
    MATHEMATICS, 2023, 11 (03)
  • [32] Recursive modified dense network for single-image deraining
    Chai, Guoqiang
    Wang, Zhaoba
    Guo, Guodong
    Chen, Youxing
    Jin, Yong
    Wang, Wei
    Zhao, Xia
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (03)
  • [33] Single Image Deraining via Recurrent Hierarchy Enhancement Network
    Yang, Youzhao
    Lu, Hong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1814 - 1822
  • [34] Multi-scale representation for image deraining with state space model
    Li, Yufeng
    Xie, Chuanlong
    Chen, Hongming
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [35] Single image deraining using Context Aggregation Recurrent Network?
    Tang, Qunfang
    Yang, Jie
    Liu, Haibo
    Guo, Zhiqiang
    Jia, Wenjing
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
  • [36] SYMBOLIC CONSTRUCTION OF A 2-D SCALE-SPACE IMAGE
    SAUND, E
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (08) : 817 - 830
  • [37] Image deraining using multi-scale aggregated generator network
    Zhang, Yan
    Zhang, Juan
    Wang, Feng
    Guo, Mengyan
    Cai, Lizhi
    Liu, Qiaohong
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (06)
  • [38] Single-image deraining algorithm based on multi-stage recurrent network
    Li, Chen
    Li, Xueting
    Guo, Yecai
    Li, Jia
    IET IMAGE PROCESSING, 2024, 18 (03) : 650 - 663
  • [39] Denseformer for Single Image Deraining
    Wang, Tianming
    Wang, Kaige
    Li, Qing
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2023, 33 (04) : 651 - 661
  • [40] Single image deraining using multi-scales context information and attention network
    Li, Pengcheng
    Gai, Shan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90