Meta transfer evidence deep learning for trustworthy few-shot classification

被引:1
作者
Liu, Tong [1 ]
Wen, Chaoyu [1 ]
Xiong, Qiangwei [1 ]
Li, Jin [1 ]
机构
[1] Yunnan Univ, Software Sch, Kunming, Peoples R China
关键词
Trustworthy classification; Meta-learning; Transfer learning; Uncertainty quantification; OOD detection; Active learning;
D O I
10.1016/j.eswa.2024.125371
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although the standard meta-learning methods have demonstrated strong performance in few-shot image classification scenarios, the models typically lack the capability to assess the reliability of their predictions, which can lead to risks in certain applications. Aiming at this problem, we first propose a meta-learning-based Evidential Deep Learning (EDL) called Meta Evidence Deep Learning (MetaEDL), which enables reliable prediction in the few-show image classification scenario. Being the same as general meta-learning methods, MetaEDL commonly employed shallow neural networks as feature extractors to avoid overfitting when dealing with few-shot samples, which significantly restricts the model's ability to extract features. To further address this limitation, we propose a Meta Transfer Evidence Deep Learning (MetaTEDL) to address the few-shot trustworthy classification issue. MetaTEDL adopts a large-scale pre-trained neural network as its feature extractor. In the meta-training process, we only train two lightweight neuron operations Scaling and Shifting to reduce the risk of over-fitting. Then, two evidential head neural networks are trained to integrate evidence from different sources, aiming to improve the quality of the evidence output. We conduct comprehensive experiments on several challenging few-shot classification benchmarks. The results indicate that our proposed method not only outperforms other conventional meta-learning methods in terms of few-shot classification performance, but also has good UQ (uncertainty quantification), Uncertainty-guided active learning, and OOD (Out-of-Distribution) detection capabilities.
引用
收藏
页数:12
相关论文
共 54 条
[1]   Evidential Deep Learning for Open Set Action Recognition [J].
Bao, Wentao ;
Yu, Qi ;
Kong, Yu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :13329-13338
[2]   The need for uncertainty quantification in machine-assisted medical decision making [J].
Begoli, Edmon ;
Bhattacharya, Tanmoy ;
Kusnezov, Dimitri .
NATURE MACHINE INTELLIGENCE, 2019, 1 (01) :20-23
[3]  
Bertinetto L, 2019, Arxiv, DOI arXiv:1805.08136
[4]  
Bishop CM., 2006, Pattern Recognition and Machine Learning
[5]  
Charpentier B, 2020, ADV NEUR IN, V33
[6]  
Chen WY, 2020, Arxiv, DOI arXiv:1904.04232
[7]  
Chi ZQ, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P2874
[8]  
Deng Danruo, P MACHINE LEARNING R
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]  
Finn C, 2017, PR MACH LEARN RES, V70