A novel meta-learning framework: Multi-features adaptive aggregation method with information enhancer

被引:6
|
作者
Ye, Hailiang [1 ]
Wang, Yi [1 ]
Cao, Feilong [1 ]
机构
[1] China Jiliang Univ, Coll Sci, Hangzhou 310018, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Meta-learning; Feature extraction; Few-shot classification; SHOT; NETWORK;
D O I
10.1016/j.neunet.2021.09.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has shown its great potential in the field of image classification due to its powerful feature extraction ability, which heavily depends on the number of available training samples. However, it is still a huge challenge on how to obtain an effective feature representation and further learn a promising classifier by deep networks when faced with few-shot classification tasks. This paper proposes a multi-features adaptive aggregation meta-learning method with an information enhancer for few-shot classification tasks, referred to as MFAML. It contains three main modules, including a feature extraction module, an information enhancer, and a multi-features adaptive aggregation classifier (MFAAC). During the meta-training stage, the information enhancer comprised of some deconvolutional layers is designed to promote the effective utilization of samples and thereby capturing more valuable information in the process of feature extraction. Simultaneously, the MFAAC module integrates the features from several convolutional layers of the feature extraction module. The obtained features then feed into the similarity module so that implementing the adaptive adjustment of the predicted label. The information enhancer and MFAAC are connected by a hybrid loss, providing an excellent feature representation. During the meta-test stage, the information enhancer is removed and we keep the remaining architecture for fast adaption on the final target task. The whole MFAML framework is solved by the optimization strategy of model-agnostic meta-learner (MAML) and can effectively improve generalization performance. Experimental results on several benchmark datasets demonstrate the superiority of the proposed method over other representative few-shot classification methods. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 46 条
  • [31] A meta-learning network method for few-shot multi-class classification problems with numerical data
    Wu, Lang
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (02) : 2639 - 2652
  • [32] A meta-learning network method for few-shot multi-class classification problems with numerical data
    Lang Wu
    Complex & Intelligent Systems, 2024, 10 : 2639 - 2652
  • [33] A novel method for accurately monitoring and predicting tool wear under varying cutting conditions based on meta-learning
    Li, Yingguang
    Liu, Changqing
    Hua, Jiaqi
    Gao, James
    Maropoulos, Paul
    CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2019, 68 (01) : 487 - 490
  • [34] A meta-learning method for smart manufacturing: Tool wear prediction using hybrid information under various operating conditions
    Mo, Xuandong
    Hu, Xiaofeng
    Sun, Andong
    Zhang, Yahui
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2025, 91
  • [35] A Novel Meta-Learning Network With Adaptive Input Length and Attention Mechanism for Bearing Fault Diagnosis Under Different Working Conditions
    Zheng, Zhiwei
    Yi, Cai
    Lin, Jianhui
    IEEE SENSORS JOURNAL, 2023, 23 (22) : 27696 - 27708
  • [36] IAQ-STL-ML: A novel indoor air quality prediction pipeline using meta-learning framework with STL decomposition
    Yin, Helin
    Jin, Dong
    Hong, Heeji
    Moon, Jaewon
    Gu, Yeong Hyeon
    ENVIRONMENTAL TECHNOLOGY & INNOVATION, 2025, 38
  • [37] A concise subspace projection based meta-learning method for fast modeling and monitoring in multi-grade semiconductor process
    Liu, Jingxiang
    Zhu, Weimin
    Mu, Guoqing
    Chen, Chun -, I
    Chen, Junghui
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 188
  • [38] A multi-step loss meta-learning method based on multi-scale feature extraction for few-shot fault diagnosis
    Xu, Zhenheng
    Liu, Zhong
    Tian, Bing
    Lv, Qiancheng
    Liu, Hu
    INSIGHT, 2024, 66 (05) : 294 - 304
  • [39] Research on Gas-Insulated Switchgear Partial Discharge Diagnosis and Location Method Based on Multi-Task Meta-Learning
    Wang, Yanxin
    Yan, Jing
    Geng, Yingsan
    Liu, Zhiyuan
    Wang, Jianhua
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2024, 58 (07): : 105 - 115
  • [40] Multi-source information fusion meta-learning network with convolutional block attention module for bearing fault diagnosis under limited dataset
    Song, Shanshan
    Zhang, Shuqing
    Dong, Wei
    Li, Gaochen
    Pan, Chengyu
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2024, 23 (02): : 818 - 835