DDFSRM: Denoising Diffusion Fusion Model for Line-Scanning Super-Resolution

被引:2
作者
Liu, Rui [1 ]
Xiao, Ying [1 ]
Peng, Yini [1 ]
Tian, Xin [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Imaging; Noise reduction; Generative adversarial networks; Diffusion models; Deep learning; Superresolution; Denoising diffusion probabilistic model; line-scanning; model-based guidance; super-resolution; IMAGE SUPERRESOLUTION; INTERPOLATION;
D O I
10.1109/TCI.2024.3458468
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Line-scanning super-resolution (LSSR) provides a new way to improve the spatial resolution of images. To further improve its super-resolution (SR) performance boosted by deep learning, a new denoising diffusion fusion super-resolution model (DDFSRM) is proposed in this paper. Considering the reconstruction optimization problem in LSSR is ill-posed, we first build a model-based fusion SR guidance and take the diffusion model sampling mean as an implicit prior learned from data to constrain the optimization model, which improves the model's accuracy. Then, the solution of the model is embedded in the iterative process of diffusion sampling. Finally, a posterior sampling model based on the denoising diffusion probabilistic model for LSSR task is obtained to achieve a good balance between denoising and SR capabilities by combining explicit and implicit priors. Both simulated and real experiments show that DDFSRM outperforms other state-of-the-art SR methods in both qualitative and quantitative evaluation.
引用
收藏
页码:1357 / 1367
页数:11
相关论文
共 43 条
  • [1] An Augmented Lagrangian Method for Total Variation Video Restoration
    Chan, Stanley H.
    Khoshabeh, Ramsin
    Gibson, Kristofor B.
    Gill, Philip E.
    Nguyen, Truong Q.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (11) : 3097 - 3111
  • [2] Chen HJ, 2015, PROC CVPR IEEE, P2358, DOI 10.1109/CVPR.2015.7298849
  • [3] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [4] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [5] Single-pixel imaging via compressive sampling
    Duarte, Marco F.
    Davenport, Mark A.
    Takhar, Dharmpal
    Laska, Jason N.
    Sun, Ting
    Kelly, Kevin F.
    Baraniuk, Richard G.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (02) : 83 - 91
  • [6] Deep learning-based point-scanning super-resolution imaging
    Fang, Linjing
    Monroe, Fred
    Novak, Sammy Weiser
    Kirk, Lyndsey
    Schiavon, Cara R.
    Yu, Seungyoon B.
    Zhang, Tong
    Wu, Melissa
    Kastner, Kyle
    Latif, Alaa Abdel
    Lin, Zijun
    Shaw, Andrew
    Kubota, Yoshiyuki
    Mendenhall, John
    Zhang, Zhao
    Pekkurnaz, Gulcin
    Harris, Kristen
    Howard, Jeremy
    Manor, Uri
    [J]. NATURE METHODS, 2021, 18 (04) : 406 - +
  • [7] Generative Diffusion Prior for Unified Image Restoration and Enhancement
    Fei, Ben
    Lyu, Zhaoyang
    Pan, Liang
    Zhang, Junzhe
    Yang, Weidong
    Luo, Tianyue
    Zhang, Bo
    Dai, Bo
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9935 - 9946
  • [8] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] Ho J., 2020, Advances in Neural Information Processing Systems, V33, P6840