Few-Shot Learning for Image Denoising

被引:11
|
作者
Jiang, Bo [1 ]
Lu, Yao [1 ]
Zhang, Bob [2 ]
Lu, Guangming [1 ,3 ]
机构
[1] Harbin Inst Technol Shenzhen, Dept Comp Sci & Technol, Shenzhen 518057, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518057, Peoples R China
关键词
Noise reduction; Noise measurement; Image denoising; Image reconstruction; Feature extraction; Task analysis; Training; few-shot learning; basic feature learner; denoising feature inducer; shared image reconstructor; multi-scale feature recursive;
D O I
10.1109/TCSVT.2023.3248585
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep Neural Networks (DNNs) have achieved impressive results on the task of image denoising, but there are two serious problems. First, the denoising ability of DNNs-based image denoising models using traditional training strategies heavily relies on extensive training on clean-noise image pairs. Second, image denoising models based on DNNs usually have large parameters and high computational complexity. To address these issues, this paper proposes a two-stage Few-Shot Learning for Image Denoising (FSLID). Our FSLID is a two-stage denoising strategy integrating Basic Feature Learner (BFL), Denoising Feature Inducer (DFI), and Shared Image Reconstructor (SIR). BFL and SIR are first jointly unsupervised to train on the base image dataset Dbase consisting of easily collected high-quality clean images. Following this, the trained BFL extracts the guided features and constraint features for the noisy and corresponding clean images in the novel image dataset Dnovel , respectively. Furthermore, DFI encodes the noisy features of the noisy images in Dnovel. Then, inducing both the guided features and noisy features, DFI can generate the denoising prior features for the SIR with frozen weights to adaptively denoise the noisy images. Furthermore, we propose refined, low-channel-count, recursive multi-branch Multi-Scale Feature Recursive (MSFR) to modularly formulate an efficient DFI to capture more diverse contextual features information under a limited number of feature channels. Thus, compared with the baseline models, the FSLID composed of the proposed MSFR can significantly reduce the number of model parameters and computational complexity. Extensive experimental results demonstrate our FSLID significantly outperforms well-established baselines on multiple datasets and settings. We hope that our work will encourage further research to explore the field of few-shot image denoising.
引用
收藏
页码:4741 / 4753
页数:13
相关论文
共 50 条
  • [21] Fractal Few-Shot Learning
    Zhou, Fobao
    Huang, Wenkai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16353 - 16367
  • [22] Interventional Few-Shot Learning
    Yue, Zhongqi
    Zhang, Hanwang
    Sun, Qianru
    Hua, Xian-Sheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [23] Few-Shot Lifelong Learning
    Mazumder, Pratik
    Singh, Pravendra
    Rai, Piyush
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2337 - 2345
  • [24] Medical Tumor Image Classification Based on Few-Shot Learning
    Wang, Wenyan
    Li, Yongtao
    Lu, Kun
    Zhang, Jun
    Chen, Peng
    Yan, Ke
    Wang, Bing
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2024, 21 (04) : 715 - 724
  • [25] Few-Shot Incremental Learning for Label-to-Image Translation
    Chen, Pei
    Zhang, Yangkang
    Li, Zejian
    Sun, Lingyun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 3687 - 3697
  • [26] FEW-SHOT LEARNING FOR REMOTE SENSING IMAGE RETRIEVAL WITH MAML
    Zhong, Qian
    Chen, Ling
    Qian, Yuntao
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2446 - 2450
  • [27] Transductive clustering optimization learning for few-shot image classification
    Wang, Yi
    Bian, Xiong
    Zhu, Songhao
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [28] Few-Shot Composition Learning for Image Retrieval with Prompt Tuning
    Wu, Junda
    Wang, Rui
    Zhao, Handong
    Zhang, Ruiyi
    Lu, Chaochao
    Li, Shuai
    Henao, Ricardo
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4729 - 4737
  • [29] Unsupervised Meta-Learning for Few-Shot Image Classification
    Khodadadeh, Siavash
    Boloni, Ladislau
    Shah, Mubarak
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [30] Partner-Assisted Learning for Few-Shot Image Classification
    Ma, Jiawei
    Xie, Hanchen
    Han, Guangxing
    Chang, Shih-Fu
    Galstyan, Aram
    Abd-Almageed, Wael
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10553 - 10562