Few-Shot Learning for Image Denoising

被引:11
|
作者
Jiang, Bo [1 ]
Lu, Yao [1 ]
Zhang, Bob [2 ]
Lu, Guangming [1 ,3 ]
机构
[1] Harbin Inst Technol Shenzhen, Dept Comp Sci & Technol, Shenzhen 518057, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, PAMI Res Grp, Taipa, Macau, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518057, Peoples R China
关键词
Noise reduction; Noise measurement; Image denoising; Image reconstruction; Feature extraction; Task analysis; Training; few-shot learning; basic feature learner; denoising feature inducer; shared image reconstructor; multi-scale feature recursive;
D O I
10.1109/TCSVT.2023.3248585
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep Neural Networks (DNNs) have achieved impressive results on the task of image denoising, but there are two serious problems. First, the denoising ability of DNNs-based image denoising models using traditional training strategies heavily relies on extensive training on clean-noise image pairs. Second, image denoising models based on DNNs usually have large parameters and high computational complexity. To address these issues, this paper proposes a two-stage Few-Shot Learning for Image Denoising (FSLID). Our FSLID is a two-stage denoising strategy integrating Basic Feature Learner (BFL), Denoising Feature Inducer (DFI), and Shared Image Reconstructor (SIR). BFL and SIR are first jointly unsupervised to train on the base image dataset Dbase consisting of easily collected high-quality clean images. Following this, the trained BFL extracts the guided features and constraint features for the noisy and corresponding clean images in the novel image dataset Dnovel , respectively. Furthermore, DFI encodes the noisy features of the noisy images in Dnovel. Then, inducing both the guided features and noisy features, DFI can generate the denoising prior features for the SIR with frozen weights to adaptively denoise the noisy images. Furthermore, we propose refined, low-channel-count, recursive multi-branch Multi-Scale Feature Recursive (MSFR) to modularly formulate an efficient DFI to capture more diverse contextual features information under a limited number of feature channels. Thus, compared with the baseline models, the FSLID composed of the proposed MSFR can significantly reduce the number of model parameters and computational complexity. Extensive experimental results demonstrate our FSLID significantly outperforms well-established baselines on multiple datasets and settings. We hope that our work will encourage further research to explore the field of few-shot image denoising.
引用
收藏
页码:4741 / 4753
页数:13
相关论文
共 50 条
  • [1] Multilevel Noise Contrastive Network for Few-Shot Image Denoising
    Jiang, Bo
    Wang, Jiahuan
    Lu, Yao
    Lu, Guangming R.
    Zhang, David
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] Few-Shot Learning for Medical Image Classification
    Cai, Aihua
    Hu, Wenxin
    Zheng, Jun
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT I, 2020, 12396 : 441 - 452
  • [3] Few-Shot Hash Learning for Image Retrieval
    Wang, Yu-Xiong
    Gui, Liangke
    Hebert, Martial
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 1228 - 1237
  • [4] Few-Shot Few-Shot Learning and the role of Spatial Attention
    Lifchitz, Yann
    Avrithis, Yannis
    Picard, Sylvaine
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2693 - 2700
  • [5] Few-shot image generation with reverse contrastive learning
    Gou, Yao
    Li, Min
    Zhang, Yusen
    He, Zhuzhen
    He, Yujie
    NEURAL NETWORKS, 2024, 169 : 154 - 164
  • [6] Ornament image retrieval using few-shot learning
    Sk Maidul Islam
    Subhankar Joardar
    Arif Ahmed Sekh
    International Journal of Multimedia Information Retrieval, 2023, 12
  • [7] Only Image Cosine Embedding for Few-Shot Learning
    Gao, Songyi
    Shen, Weijie
    Liu, Zelin
    Zhu, An
    Yu, Yang
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 83 - 94
  • [8] Heterogeneous Few-Shot Learning for Hyperspectral Image Classification
    Wang, Yan
    Liu, Ming
    Yang, Yuexin
    Li, Zhaokui
    Du, Qian
    Chen, Yushi
    Li, Fei
    Yang, Haibo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] Few-shot learning for skin lesion image classification
    Xue-Jun Liu
    Kai-li Li
    Hai-ying Luan
    Wen-hui Wang
    Zhao-yu Chen
    Multimedia Tools and Applications, 2022, 81 : 4979 - 4990
  • [10] Deep Few-Shot Learning for Hyperspectral Image Classification
    Liu, Bing
    Yu, Xuchu
    Yu, Anzhu
    Zhang, Pengqiang
    Wan, Gang
    Wang, Ruirui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (04): : 2290 - 2304