A model-driven network for guided image denoising

被引:17
|
作者
Xu, Shuang [1 ]
Zhang, Jiangshe [2 ]
Wang, Jialin [3 ]
Sun, Kai [2 ]
Zhang, Chunxia [2 ]
Liu, Junmin [2 ]
Hu, Junying [4 ]
机构
[1] Northwestern Polytech Univ, Sch Math & Stat, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Math & Stat, 28 West Xianning Rd, Xian 710049, Shaanxi, Peoples R China
[3] Xi An Jiao Tong Univ, Sch Energy & Power Engn, 28 West Xianning Rd, Xian 710049, Shaanxi, Peoples R China
[4] Northwest Univ, Sch Math, 1 Xuefu Rd, Xian 710100, Shaanxi, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Guided image denoising; Multi-modal image denoising; Modality gap; PHOTOGRAPHY; ENHANCEMENT; FLASH;
D O I
10.1016/j.inffus.2022.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Guided image denoising recovers clean target images by fusing guidance images and noisy target images. Several deep neural networks have been designed for this task, but they are black-box methods lacking interpretability. To overcome the issue, this paper builds a more interpretable network. To start with, an observation model is proposed to account for modality gap between target and guidance images. Then, this paper formulates a deep prior regularized optimization problem, and solves it by alternating direction method of multipliers (ADMM) algorithm. The update rules are generalized to design the network architecture. Extensive experiments conducted on FAIP and RNS datasets manifest that the novel network outperforms several state-of-the-art and benchmark methods regarding both evaluation metrics and visual inspection.
引用
收藏
页码:60 / 71
页数:12
相关论文
共 50 条
  • [1] Unsupervised model-driven neural network based image denoising for transmission line monitoring
    YAO Nan
    WANG Zhen
    ZHANG Jun
    ZHU Xueqiong
    XUE Hai
    Optoelectronics Letters, 2023, 19 (04) : 248 - 251
  • [2] Unsupervised model-driven neural network based image denoising for transmission line monitoring
    Nan Yao
    Zhen Wang
    Jun Zhang
    Xueqiong Zhu
    Hai Xue
    Optoelectronics Letters, 2023, 19 : 248 - 251
  • [3] Unsupervised model-driven neural network based image denoising for transmission line monitoring
    Yao, Nan
    Wang, Zhen
    Zhang, Jun
    Zhu, Xueqiong
    Xue, Hai
    OPTOELECTRONICS LETTERS, 2023, 19 (04) : 248 - 251
  • [4] Hyperspectral Image Denoising: From Model-Driven, Data-Driven, to Model-Data-Driven
    Zhang, Qiang
    Zheng, Yaming
    Yuan, Qiangqiang
    Song, Meiping
    Yu, Haoyang
    Xiao, Yi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13143 - 13163
  • [5] MD3: Model-Driven Deep Remotely Sensed Image Denoising
    Huang, Zhenghua
    Zhu, Zifan
    Zhang, Yaozong
    Wang, Zhicheng
    Xu, Biyun
    Liu, Jun
    Li, Shaoyi
    Fang, Hao
    REMOTE SENSING, 2023, 15 (02)
  • [6] Learning a Model-Driven Variational Network for Deformable Image Registration
    Jia, Xi
    Thorley, Alexander
    Chen, Wei
    Qiu, Huaqi
    Shen, Linlin
    Styles, Iain B.
    Chang, Hyung Jin
    Leonardis, Ales
    de Marvao, Antonio
    O'Regan, Declan P.
    Rueckert, Daniel
    Duan, Jinming
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (01) : 199 - 212
  • [7] L1 model-driven recursive multi-scale denoising network for image super-resolution
    Sun, Zhongfan
    Zhao, Jianwei
    Zhou, Zhenghua
    Gao, Qingqing
    KNOWLEDGE-BASED SYSTEMS, 2021, 225
  • [8] Searching Efficient Model-Guided Deep Network for Image Denoising
    Ning, Qian
    Dong, Weisheng
    Li, Xin
    Wu, Jinjian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 668 - 681
  • [9] A Model-driven Deep Neural Network for Single Image Rain Removal
    Wang, Hong
    Xie, Qi
    Zhao, Qian
    Meng, Deyu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3100 - 3109
  • [10] Content and Gradient Model-driven Deep Network for Single Image Reflection Removal
    Zhang, Ya-Nan
    Shen, Linlin
    Li, Qiufu
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6802 - 6812