A novel meta-learning framework: Multi-features adaptive aggregation method with information enhancer

被引:6
|
作者
Ye, Hailiang [1 ]
Wang, Yi [1 ]
Cao, Feilong [1 ]
机构
[1] China Jiliang Univ, Coll Sci, Hangzhou 310018, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Meta-learning; Feature extraction; Few-shot classification; SHOT; NETWORK;
D O I
10.1016/j.neunet.2021.09.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has shown its great potential in the field of image classification due to its powerful feature extraction ability, which heavily depends on the number of available training samples. However, it is still a huge challenge on how to obtain an effective feature representation and further learn a promising classifier by deep networks when faced with few-shot classification tasks. This paper proposes a multi-features adaptive aggregation meta-learning method with an information enhancer for few-shot classification tasks, referred to as MFAML. It contains three main modules, including a feature extraction module, an information enhancer, and a multi-features adaptive aggregation classifier (MFAAC). During the meta-training stage, the information enhancer comprised of some deconvolutional layers is designed to promote the effective utilization of samples and thereby capturing more valuable information in the process of feature extraction. Simultaneously, the MFAAC module integrates the features from several convolutional layers of the feature extraction module. The obtained features then feed into the similarity module so that implementing the adaptive adjustment of the predicted label. The information enhancer and MFAAC are connected by a hybrid loss, providing an excellent feature representation. During the meta-test stage, the information enhancer is removed and we keep the remaining architecture for fast adaption on the final target task. The whole MFAML framework is solved by the optimization strategy of model-agnostic meta-learner (MAML) and can effectively improve generalization performance. Experimental results on several benchmark datasets demonstrate the superiority of the proposed method over other representative few-shot classification methods. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 46 条
  • [21] Meta-HFMD: A Hierarchical Feature Fusion Malware Detection Framework via Multi-task Meta-learning
    Liu, Yao
    Bai, Xiaoyu
    Liu, Qiao
    Lan, Tian
    Zhou, Le
    Zhou, Tinghao
    FRONTIERS IN CYBER SECURITY, FCS 2023, 2024, 1992 : 638 - 654
  • [22] A unified framework for reinforcement learning, co-learning and meta-learning how to coordinate in collaborative multi-agent systems
    Tosic, Predrag T.
    Vilalta, Ricardo
    ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01): : 2211 - 2220
  • [23] Meta-Seg: A Generalized Meta-Learning Framework for Multi-Class Few-Shot Semantic Segmentation
    Cao, Zhiying
    Zhang, Tengfei
    Diao, Wenhui
    Zhang, Yue
    Lyu, Xiaode
    Fu, Kun
    Sun, Xian
    IEEE ACCESS, 2019, 7 : 166109 - 166121
  • [24] An Automatic Recommendation Method for Single-Cell DNA Variant Callers Based on Meta-Learning Framework
    Wang, Jinhui
    Zhao, Xinyi
    Wang, Jiayin
    BIOINFORMATICS RESEARCH AND APPLICATIONS, PT II, ISBRA 2024, 2024, 14955 : 269 - 280
  • [25] A novel cross-domain fault diagnosis method based on model agnostic meta-learning
    Yang, Tianyuan
    Tang, Tang
    Wang, Jingwei
    Qiu, Chuanhang
    Chen, Ming
    MEASUREMENT, 2022, 199
  • [26] What is behind the meta-learning initialization of adaptive filter? - A naive method for accelerating convergence of adaptive multichannel active noise control
    Shi, Dongyuan
    Gan, Woon-seng
    Shen, Xiaoyi
    Luo, Zhengding
    Ji, Junwei
    NEURAL NETWORKS, 2024, 172
  • [27] A Hybrid Deep Learning Method to Extract Multi-features from Reviews and User-Item Relations for Rating Prediction
    Lai, Chin-Hui
    Peng, Pang-Yu
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [28] A Multi-Label Classification With Hybrid Label-Based Meta-Learning Method in Internet of Things
    Lin, Sung-Chiang
    Chen, Chih-Jou
    Lee, Tsung-Ju
    IEEE ACCESS, 2020, 8 : 42261 - 42269
  • [29] A novel method based on meta-learning for bearing fault diagnosis with small sample learning under different working conditions
    Su, Hao
    Xiang, Ling
    Hu, Aijun
    Xu, Yonggang
    Yang, Xin
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 169
  • [30] A Multi-Task Causal Knowledge Fault Diagnosis Method for PMSM-ITSF Based on Meta-Learning
    Lan, Ping
    Yao, Liguo
    Lu, Yao
    Zhang, Taihua
    SENSORS, 2025, 25 (04)