Improved Convolutional Rain Removal Algorithm for Single Image Based on Graph Network

被引:0
|
作者
Zhou Jinxiang [1 ]
Li Zhiwei [1 ,2 ]
Qiu Huowang [1 ]
Ren Yuanhong [2 ]
Zhou Wuneng [2 ]
机构
[1] Shanghai Univ Engn Sci, Coll Elect & Elect Engn, Shanghai 201406, Peoples R China
[2] Donghua Univ, Coll Informat Sci & Technol, Shanghai 201620, Peoples R China
关键词
image rain removal; deep convolutional neural network; graph network; graph node; improved convolution; QUALITY;
D O I
10.3788/LOP213091
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image deraining is the process of reconstructing a high-definition background image by removing rain marks. The deep convolutional neural network is now the most widely used to eliminate rain streaks. The core of the convolution operation is parameters globally sharing, which remarkably reduces the amount of calculation and improves the generalization ability of the algorithm. However, this also makes the convolution operation unable to effectively consider the connections between local parts and the influence of the distant pixels on the operated region. This will result in an over- smoothing phenomenon in single image deraining. Inspired by the great success that graph network has achieved in recent years, we hope to improve the convolution method by combining the kernel idea of graph network. First, all pixels are treated as graph nodes, the similarity between neighboring pixels is estimated, and the threshold value determines whether or not an edge connection exists. After the graph structure construction is completed, the obtained adjacent matrix and the similarity matrix will be used during the convolution operation, the parameters of the convolution kernel are adjusted, and the connection between the pixels and the extraction of topological information are fully considered. The intensive comparison experiments of several states-of-the-arts on several benchmark datasets show the effectiveness of the proposed enhanced convolution, which can effectively promote the performance of various latest algorithms without increasing a lot of computing resources.
引用
收藏
页数:7
相关论文
共 30 条
  • [1] [班玛宝 Ban Mabao], 2022, [北京大学学报. 自然科学版, Acta Scientiarum Naturalium Universitatis Pekinensis], V58, P91
  • [2] DehazeNet: An End-to-End System for Single Image Haze Removal
    Cai, Bolun
    Xu, Xiangmin
    Jia, Kui
    Qing, Chunmei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) : 5187 - 5198
  • [3] [常亮 Chang Liang], 2016, [自动化学报, Acta Automatica Sinica], V42, P1300
  • [4] Weakly Supervised Object Localization with Multi-Fold Multiple Instance Learning
    Cinbis, Ramazan Gokberk
    Verbeek, Jakob
    Schmid, Cordelia
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (01) : 189 - 203
  • [5] Defferrard M, 2016, ADV NEUR IN, V29
  • [6] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [7] Single-shot spectral-volumetric compressed ultrafast photography
    Ding, Pengpeng
    Yao, Yunhua
    Qi, Dalong
    Yang, Chengshuai
    Cao, Fengyan
    He, Yilin
    Yao, Jiali
    Jin, Chengzhi
    Huang, Zhengqi
    Deng, Li
    Deng, Lianzhong
    Jia, Tianqing
    Liang, Jinyang
    Sun, Zhenrong
    Zhang, Shian
    [J]. ADVANCED PHOTONICS, 2021, 3 (04):
  • [8] Goodfellow I. J., arXiv, DOI DOI 10.48550/ARXIV.1406.2661
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] Peak-to-average power ratio reduction for an artificial noise aided secure communication system
    Hong, Tao
    Li, Zhi-peng
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE), 2016, : 1370 - 1374