A model-driven network for guided image denoising

被引:17
|
作者
Xu, Shuang [1 ]
Zhang, Jiangshe [2 ]
Wang, Jialin [3 ]
Sun, Kai [2 ]
Zhang, Chunxia [2 ]
Liu, Junmin [2 ]
Hu, Junying [4 ]
机构
[1] Northwestern Polytech Univ, Sch Math & Stat, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Math & Stat, 28 West Xianning Rd, Xian 710049, Shaanxi, Peoples R China
[3] Xi An Jiao Tong Univ, Sch Energy & Power Engn, 28 West Xianning Rd, Xian 710049, Shaanxi, Peoples R China
[4] Northwest Univ, Sch Math, 1 Xuefu Rd, Xian 710100, Shaanxi, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Guided image denoising; Multi-modal image denoising; Modality gap; PHOTOGRAPHY; ENHANCEMENT; FLASH;
D O I
10.1016/j.inffus.2022.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Guided image denoising recovers clean target images by fusing guidance images and noisy target images. Several deep neural networks have been designed for this task, but they are black-box methods lacking interpretability. To overcome the issue, this paper builds a more interpretable network. To start with, an observation model is proposed to account for modality gap between target and guidance images. Then, this paper formulates a deep prior regularized optimization problem, and solves it by alternating direction method of multipliers (ADMM) algorithm. The update rules are generalized to design the network architecture. Extensive experiments conducted on FAIP and RNS datasets manifest that the novel network outperforms several state-of-the-art and benchmark methods regarding both evaluation metrics and visual inspection.
引用
收藏
页码:60 / 71
页数:12
相关论文
共 50 条
  • [11] Interpretable Model-Driven Deep Network for Hyperspectral, Multispectral, and Panchromatic Image Fusion
    Tian, Xin
    Li, Kun
    Zhang, Wei
    Wang, Zhongyuan
    Ma, Jiayi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14382 - 14395
  • [12] DM-Fusion: Deep Model-Driven Network for Heterogeneous Image Fusion
    Xu, Guoxia
    He, Chunming
    Wang, Hao
    Zhu, Hu
    Ding, Weiping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 10071 - 10085
  • [13] Model-guided boosting for image denoising
    Xie, Zhonghua
    Liu, Lingjun
    Wang, Cheng
    SIGNAL PROCESSING, 2022, 201
  • [14] Self-Guided Network for Fast Image Denoising
    Gu, Shuhang
    Li, Yawei
    Van Gool, Luc
    Timofte, Radu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2511 - 2520
  • [15] Multilevel Edge Features Guided Network for Image Denoising
    Fang, Faming
    Li, Juncheng
    Yuan, Yiting
    Zeng, Tieyong
    Zhang, Guixu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (09) : 3956 - 3970
  • [16] A model-driven framework for guided design space exploration
    Hegedues, Abel
    Horvath, Akos
    Varro, Daniel
    AUTOMATED SOFTWARE ENGINEERING, 2015, 22 (03) : 399 - 436
  • [17] A model-driven framework for guided design space exploration
    Ábel Hegedüs
    Ákos Horváth
    Dániel Varró
    Automated Software Engineering, 2015, 22 : 399 - 436
  • [18] Adaptive weighted rain streaks model-driven deep network for single image deraining
    Zhang, Ya-Nan
    Shen, Linlin
    Lai, Zhihui
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 222
  • [19] Efficient Model-Driven Network for Shadow Removal
    Zhu, Yurui
    Xiao, Zeyu
    Fang, Yanchi
    Fu, Xueyang
    Xiong, Zhiwei
    Zha, Zheng-Jun
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3635 - 3643
  • [20] Model-driven designs of an oscillating gene network
    Tuttle, LM
    Salis, H
    Tomshine, J
    Kaznessis, YN
    BIOPHYSICAL JOURNAL, 2005, 89 (06) : 3873 - 3883