Convolutional Shrinkage Neural Networks Based Model-Agnostic Meta-Learning for Few-Shot Learning

被引:0
作者
Yunpeng He
Chuanzhi Zang
Peng Zeng
Qingwei Dong
Ding Liu
Yuqi Liu
机构
[1] Chinese Academy of Sciences,State Key Laboratory of Robotics, Shenyang Institute of Automation
[2] Chinese Academy of Sciences,Key Laboratory of Networked Control Systems
[3] Chinese Academy of Sciences,Institutes for Robotics and Intelligent Manufacturing
[4] University of Chinese Academy of Sciences,undefined
[5] Shenyang University of Technology,undefined
来源
Neural Processing Letters | 2023年 / 55卷
关键词
Meta learning; Few-shot learning; Residual networks; Soft thresholding;
D O I
暂无
中图分类号
学科分类号
摘要
Meta Learning (ML) has the ability to quickly learn from a small number of samples, and has become an important research field after reinforcement learning. However, the complexity of sample features severely reduces the performance of few-shot learning, and proper feature selection plays a vital role in the performance of neural networks. To address this problem, this article draws up a new type of convolutional neural network with an attention mechanism, namely, convolutional shrinkage neural networks (CSNNs), using the characteristics of negligible noise to obtain a good optimization parameter model. Moreover, soft thresholding is inserted into the network architectures as nonlinear transformation layers to eliminate nonessential features. In addition, considering that it is difficult to set appropriate values for the thresholds, the developed convolutional shrinkage neural networks integrates some specialized neural networks into trainable modules to automatically set the thresholds. To illustrate the effectiveness of the proposed method, the model-agnostic meta-learning method is considered for testing. The results show that the improved method can significantly improve the accuracy of few-shot images classification and enhance the generalization performance.
引用
收藏
页码:505 / 518
页数:13
相关论文
共 45 条
  • [1] Tang WX(2021)An automatic cost learning framework for image steganography using deep reinforcement learning IEEE Trans Inf Forensics Secur 16 952-967
  • [2] Li B(2021)Deep Learning for Anomaly Detection: A Review ACM Comput Surv 54 1-38
  • [3] Barni M(2019)RNN for Solving Perturbed Time-Varying Underdetermined Linear System With Double Bound Limits on Residual Errors and State Variables IEEE Trans Ind Inform 15 5931-5942
  • [4] Pang G(2020)Matchinggan: Matching-Based Few-Shot Image Generation IEEE Int Conf Multimed Expo (ICME) 2020 1-6
  • [5] Shen C(2015)Human-level concept learning through probabilistic program induction Science 350 1332-1338
  • [6] Cao L(2020)A Two-Stage Approach to Few-Shot Learning for Image Recognition IEEE Trans Image Process 29 3336-3350
  • [7] Lu H(2020)Model-Agnostic Metalearning-Based Text-Driven Visual Navigation Model for Unfamiliar Tasks IEEE Access 8 166742-166752
  • [8] Jin L(2018)Deep shrinkage convolutional neural network for adaptive noise reduction IEEE Signal Process Lett 25 224-228
  • [9] Luo X(2020)Deep Residual Shrinkage Networks for Fault Diagnosis IEEE Trans Industr Inf 16 4681-4690
  • [10] Hong Y(2020)Squeeze-and-Excitation Networks IEEE Trans Pattern Anal Mach Intell 42 2011-2023