A novel meta-learning framework: Multi-features adaptive aggregation method with information enhancer

被引:6
|
作者
Ye, Hailiang [1 ]
Wang, Yi [1 ]
Cao, Feilong [1 ]
机构
[1] China Jiliang Univ, Coll Sci, Hangzhou 310018, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Meta-learning; Feature extraction; Few-shot classification; SHOT; NETWORK;
D O I
10.1016/j.neunet.2021.09.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has shown its great potential in the field of image classification due to its powerful feature extraction ability, which heavily depends on the number of available training samples. However, it is still a huge challenge on how to obtain an effective feature representation and further learn a promising classifier by deep networks when faced with few-shot classification tasks. This paper proposes a multi-features adaptive aggregation meta-learning method with an information enhancer for few-shot classification tasks, referred to as MFAML. It contains three main modules, including a feature extraction module, an information enhancer, and a multi-features adaptive aggregation classifier (MFAAC). During the meta-training stage, the information enhancer comprised of some deconvolutional layers is designed to promote the effective utilization of samples and thereby capturing more valuable information in the process of feature extraction. Simultaneously, the MFAAC module integrates the features from several convolutional layers of the feature extraction module. The obtained features then feed into the similarity module so that implementing the adaptive adjustment of the predicted label. The information enhancer and MFAAC are connected by a hybrid loss, providing an excellent feature representation. During the meta-test stage, the information enhancer is removed and we keep the remaining architecture for fast adaption on the final target task. The whole MFAML framework is solved by the optimization strategy of model-agnostic meta-learner (MAML) and can effectively improve generalization performance. Experimental results on several benchmark datasets demonstrate the superiority of the proposed method over other representative few-shot classification methods. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 46 条
  • [41] MAML-SR: Self-adaptive super-resolution networks via multi-scale optimized attention-aware meta-learning
    Pal, Debabrata
    Bose, Shirsha
    More, Deeptej
    Jha, Ankit
    Banerjee, Biplab
    Jeppu, Yogananda
    PATTERN RECOGNITION LETTERS, 2023, 173 : 101 - 107
  • [42] A Novel Short-Term Residential Electric Load Forecasting Method Based on Adaptive Load Aggregation and Deep Learning Algorithms
    Hou, Tingting
    Fang, Rengcun
    Tang, Jinrui
    Ge, Ganheng
    Yang, Dongjun
    Liu, Jianchao
    Zhang, Wei
    ENERGIES, 2021, 14 (22)
  • [43] Limited data-oriented building heating load prediction method: A novel meta learning-based framework
    Lu, Yakai
    Peng, Xingyu
    Li, Conghui
    Tian, Zhe
    Kong, Xiangfei
    ENERGY AND BUILDINGS, 2024, 308
  • [44] A novel fault diagnosis method based on multi-level information fusion and hierarchical adaptive convolutional neural networks for centrifugal blowers
    Zhang, You
    Li, Congbo
    Wang, Rui
    Qian, Jing
    MEASUREMENT, 2021, 185 (185)
  • [45] A novel deep learning based probabilistic power flow method for Multi-Microgrids distribution system with incomplete network information
    Xiao, Hao
    Pei, Wei
    Wu, Lei
    Ma, Li
    Ma, Tengfei
    Hua, Weiqi
    APPLIED ENERGY, 2023, 335
  • [46] A Novel Framework of IoT-Based Multi-Disease Monitoring System Using Heuristic Improvement of Adaptive Dilated and Attention-Based Deep Learning Approaches
    Nainwal, Manoj
    Reddy, Y. Madhu Sudhana
    Dhaygude, Amol Dattatray
    Ramesh, Gopisetty
    Govindasamy, Chinnaraj
    Mouli, D. V. V. V. C. H.
    CYBERNETICS AND SYSTEMS, 2025,