Trusted Multi-View Classification With Dynamic Evidential Fusion

被引:161
作者
Han, Zongbo [1 ]
Zhang, Changqing [1 ]
Fu, Huazhu [2 ]
Zhou, Joey Tianyi [3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] ASTAR, Inst High Performance Comp IHPC, Singapore 138632, Singapore
[3] ASTAR, A STAR Ctr Frontier AI Res CFAR, Singapore 138632, Singapore
基金
中国国家自然科学基金;
关键词
Evidential deep learning; multi-view learning; varitional Dirichlet; SHAFER EVIDENCE THEORY; BAYESIAN-APPROACH; DIAGNOSIS;
D O I
10.1109/TPAMI.2022.3171983
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing multi-view classification algorithms focus on promoting accuracy by exploiting different views, typically integrating them into common representations for follow-up tasks. Although effective, it is also crucial to ensure the reliability of both the multi-view integration and the final decision, especially for noisy, corrupted and out-of-distribution data. Dynamically assessing the trustworthiness of each view for different samples could provide reliable integration. This can be achieved through uncertainty estimation. With this in mind, we propose a novel multi-view classification algorithm, termed trusted multi-view classification (TMC), providing a new paradigm for multi-view learning by dynamically integrating different views at an evidence level. The proposed TMC can promote classification reliability by considering evidence from each view. Specifically, we introduce the variational Dirichlet to characterize the distribution of the class probabilities, parameterized with evidence from different views and integrated with the Dempster-Shafer theory. The unified learning framework induces accurate uncertainty and accordingly endows the model with both reliability and robustness against possible noise or corruption. Both theoretical and experimental results validate the effectiveness of the proposed model in accuracy, robustness and trustworthiness.
引用
收藏
页码:2551 / 2566
页数:16
相关论文
共 108 条
[1]  
Akaho Shotaro, 2006, arXiv
[2]  
Andrew G., 2013, Proceedings of the 30th International Conference on Machine Learning, P1247
[3]  
Antoran J., 2020, ADV NEUR IN, V33
[4]   Multimodal fusion for multimedia analysis: a survey [J].
Atrey, Pradeep K. ;
Hossain, M. Anwar ;
El Saddik, Abdulmotaleb ;
Kankanhalli, Mohan S. .
MULTIMEDIA SYSTEMS, 2010, 16 (06) :345-379
[5]  
Ayub A., 2020, PROC BRIT MACH VIS C, P1
[6]  
Bachman P, 2019, ADV NEUR IN, V32
[7]   Evidential Deep Learning for Open Set Action Recognition [J].
Bao, Wentao ;
Yu, Qi ;
Kong, Yu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :13329-13338
[8]   Engine fault diagnosis based on multi-sensor information fusion using Dempster-Shafer evidence theory [J].
Basir, Otman ;
Yuan, Xiaohong .
INFORMATION FUSION, 2007, 8 (04) :379-386
[9]  
Bernardo J.M., 2009, BAYESIAN THEORY
[10]  
Bian Y., 2017, ARXIV