Few-Shot Learning for Image Denoising

被引:11
|
作者
Jiang, Bo [1 ]
Lu, Yao [1 ]
Zhang, Bob [2 ]
Lu, Guangming [1 ,3 ]
机构
[1] Harbin Inst Technol Shenzhen, Dept Comp Sci & Technol, Shenzhen 518057, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518057, Peoples R China
关键词
Noise reduction; Noise measurement; Image denoising; Image reconstruction; Feature extraction; Task analysis; Training; few-shot learning; basic feature learner; denoising feature inducer; shared image reconstructor; multi-scale feature recursive;
D O I
10.1109/TCSVT.2023.3248585
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep Neural Networks (DNNs) have achieved impressive results on the task of image denoising, but there are two serious problems. First, the denoising ability of DNNs-based image denoising models using traditional training strategies heavily relies on extensive training on clean-noise image pairs. Second, image denoising models based on DNNs usually have large parameters and high computational complexity. To address these issues, this paper proposes a two-stage Few-Shot Learning for Image Denoising (FSLID). Our FSLID is a two-stage denoising strategy integrating Basic Feature Learner (BFL), Denoising Feature Inducer (DFI), and Shared Image Reconstructor (SIR). BFL and SIR are first jointly unsupervised to train on the base image dataset Dbase consisting of easily collected high-quality clean images. Following this, the trained BFL extracts the guided features and constraint features for the noisy and corresponding clean images in the novel image dataset Dnovel , respectively. Furthermore, DFI encodes the noisy features of the noisy images in Dnovel. Then, inducing both the guided features and noisy features, DFI can generate the denoising prior features for the SIR with frozen weights to adaptively denoise the noisy images. Furthermore, we propose refined, low-channel-count, recursive multi-branch Multi-Scale Feature Recursive (MSFR) to modularly formulate an efficient DFI to capture more diverse contextual features information under a limited number of feature channels. Thus, compared with the baseline models, the FSLID composed of the proposed MSFR can significantly reduce the number of model parameters and computational complexity. Extensive experimental results demonstrate our FSLID significantly outperforms well-established baselines on multiple datasets and settings. We hope that our work will encourage further research to explore the field of few-shot image denoising.
引用
收藏
页码:4741 / 4753
页数:13
相关论文
共 50 条
  • [41] Semi-supervised Learning for Few-shot Image-to-Image Translation
    Wang, Yaxing
    Khan, Salman
    Gonzalez-Garcia, Abel
    van de Weijer, Joost
    Khan, Fahad Shahbaz
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4452 - 4461
  • [42] LEARNING RELATION BY GRAPH NEURAL NETWORK FOR SAR IMAGE FEW-SHOT LEARNING
    Yang, Rui
    Xu, Xin
    Li, Xirong
    Wang, Lei
    Pu, Fangling
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1743 - 1746
  • [43] Co-Learning for Few-Shot Learning
    Rui Xu
    Lei Xing
    Shuai Shao
    Baodi Liu
    Kai Zhang
    Weifeng Liu
    Neural Processing Letters, 2022, 54 : 3339 - 3356
  • [44] RankDNN: Learning to Rank for Few-Shot Learning
    Guo, Qianyu
    Gong Haotong
    Wei, Xujun
    Fu, Yanwei
    Yu, Yizhou
    Zhang, Wenqiang
    Ge, Weifeng
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 728 - 736
  • [45] Learning about few-shot concept learning
    Ananya Rastogi
    Nature Computational Science, 2022, 2 : 698 - 698
  • [46] Co-Learning for Few-Shot Learning
    Xu, Rui
    Xing, Lei
    Shao, Shuai
    Liu, Baodi
    Zhang, Kai
    Liu, Weifeng
    NEURAL PROCESSING LETTERS, 2022, 54 (04) : 3339 - 3356
  • [47] Federated Few-Shot Learning with Adversarial Learning
    Fan, Chenyou
    Huang, Jianwei
    2021 19TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), 2021,
  • [48] Cross-coupled prompt learning for few-shot image recognition☆
    Zhang, Fangyuan
    Wei, Rukai
    Xie, Yanzhao
    Wang, Yangtao
    Tan, Xin
    Ma, Lizhuang
    Tang, Maobin
    Fan, Lisheng
    DISPLAYS, 2024, 85
  • [49] Few-shot learning based histopathological image classification of colorectal cancer
    Li, Rui
    Li, Xiaoyan
    Sun, Hongzan
    Yang, Jinzhu
    Rahaman, Md
    Grzegozek, Marcin
    Jiang, Tao
    Huang, Xinyu
    Li, Chen
    INTELLIGENT MEDICINE, 2024, 4 (04): : 256 - 267
  • [50] Relative Position and Map Networks in Few-shot Learning for Image Classification
    Xue, Zhiyu
    Xie, Zhenshan
    Xing, Zheng
    Duan, Lixin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4032 - 4036