A novel meta-learning framework: Multi-features adaptive aggregation method with information enhancer

被引:6
|
作者
Ye, Hailiang [1 ]
Wang, Yi [1 ]
Cao, Feilong [1 ]
机构
[1] China Jiliang Univ, Coll Sci, Hangzhou 310018, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Meta-learning; Feature extraction; Few-shot classification; SHOT; NETWORK;
D O I
10.1016/j.neunet.2021.09.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has shown its great potential in the field of image classification due to its powerful feature extraction ability, which heavily depends on the number of available training samples. However, it is still a huge challenge on how to obtain an effective feature representation and further learn a promising classifier by deep networks when faced with few-shot classification tasks. This paper proposes a multi-features adaptive aggregation meta-learning method with an information enhancer for few-shot classification tasks, referred to as MFAML. It contains three main modules, including a feature extraction module, an information enhancer, and a multi-features adaptive aggregation classifier (MFAAC). During the meta-training stage, the information enhancer comprised of some deconvolutional layers is designed to promote the effective utilization of samples and thereby capturing more valuable information in the process of feature extraction. Simultaneously, the MFAAC module integrates the features from several convolutional layers of the feature extraction module. The obtained features then feed into the similarity module so that implementing the adaptive adjustment of the predicted label. The information enhancer and MFAAC are connected by a hybrid loss, providing an excellent feature representation. During the meta-test stage, the information enhancer is removed and we keep the remaining architecture for fast adaption on the final target task. The whole MFAML framework is solved by the optimization strategy of model-agnostic meta-learner (MAML) and can effectively improve generalization performance. Experimental results on several benchmark datasets demonstrate the superiority of the proposed method over other representative few-shot classification methods. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 46 条
  • [1] A Novel Hierarchical Adaptive Feature Fusion Method for Meta-Learning
    Ding, Enjie
    Chu, Xu
    Liu, Zhongyu
    Zhang, Kai
    Yu, Qiankun
    APPLIED SCIENCES-BASEL, 2022, 12 (11):
  • [2] A Method of Few-Shot Network Intrusion Detection Based on Meta-Learning Framework
    Xu, Congyuan
    Shen, Jizhong
    Du, Xin
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 3540 - 3552
  • [3] PPFM: An Adaptive and Hierarchical Peer-to-Peer Federated Meta-Learning Framework
    Yu, Zhengxin
    Lu, Yang
    Angelov, Plamen
    Suri, Neeraj
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 502 - 509
  • [4] A fast interpretable adaptive meta-learning enhanced deep learning framework for diagnosis of diabetic retinopathy
    Wang, Maofa
    Gong, Qizhou
    Wan, Quan
    Leng, Zhixiong
    Xu, Yanlin
    Yan, Bingchen
    Zhang, He
    Huang, Hongliang
    Sun, Shaohua
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 244
  • [5] SOMeL: Multi-granular Optimized Framework for Digital Neuromorphic Meta-learning
    Yang, Shuangming
    He, Qing
    Azghadi, Mostafa Rahimi
    2024 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC 2024, 2024,
  • [6] Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning
    Zhang, Hailin
    Chen, Defang
    Wang, Can
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1943 - 1948
  • [7] A new adaptive multi-fidelity metamodel method using meta-learning and Bayesian deep learning
    Fenfen Xiong
    Chengkun Ren
    Bo Mo
    Chao Li
    Xiao Hu
    Structural and Multidisciplinary Optimization, 2023, 66
  • [8] A new adaptive multi-fidelity metamodel method using meta-learning and Bayesian deep learning
    Xiong, Fenfen
    Ren, Chengkun
    Mo, Bo
    Li, Chao
    Hu, Xiao
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2023, 66 (03)
  • [9] Multi-source adaptive meta-learning framework for domain generalization person re-identification
    Chen, Yan
    Tang, Qiuling
    Ma, Hua
    SOFT COMPUTING, 2024, 28 (06) : 4799 - 4820
  • [10] Multi-source adaptive meta-learning framework for domain generalization person re-identification
    Yan Chen
    Qiuling Tang
    Hua Ma
    Soft Computing, 2024, 28 : 4799 - 4820