Multi-Domain Adversarial Variational Bayesian Inference for Domain Generalization

被引:0
作者
Gao, Zhifan [1 ]
Guo, Saidi [1 ]
Xu, Chenchu [2 ]
Zhang, Jinglin [3 ]
Gong, Mingming [4 ]
Del Ser, Javier [5 ,6 ]
Li, Shuo [7 ,8 ]
机构
[1] Sun Yat Sen Univ, Sch Biomed Engn, Shenzhen 518107, Peoples R China
[2] Anhui Univ, Sch Comp Sci & Technol, Key Lab Intelligent Comp & Signal Proc, Informat Mat & Intelligent Sensing Lab Anhui Prov, Hefei 230601, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] Univ Melbourne, Sch Math & Stat, Parkville, Vic 3010, Australia
[5] Basque Res & Technol Alliance BRTA, TECNALIA, Mendaro 20850, Spain
[6] Univ Basque Country UPV EHU, Dept Commun Engn, Leioa 48940, Spain
[7] Case Western Reserve Univ, Dept Comp & Data Sci, Cleveland, OH 44106 USA
[8] Case Western Reserve Univ, Dept Biomed Engn, Cleveland, OH 44106 USA
基金
中国国家自然科学基金;
关键词
Bayes methods; Visualization; Adversarial machine learning; Training; Biomedical imaging; Adaptation models; Task analysis; Domain generalization; variational auto-encoder; visual object recognition;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Domain generalization aims to learn common knowledge from multiple observed source domains and transfer it to unseen target domains, e.g. the object recognition in varieties of visual environments. Traditional domain generalization methods aim to learn the feature representation of the raw data with its distribution invariant across domains. This relies on the assumption that the two posterior distributions (the distributions of the label given the feature distribution and given the raw data) are stable in different domains. However, this does not always hold in many practical situations. In this paper, we relax the above assumption by permitting the posterior distribution of the label given the raw data changes in difference domains, and thus focuses on a more realistic learning problem that infers the conditional domain-invariant feature representation. Specifically, a multi-domain adversarial variational Bayesian inference approach is proposed to minimize the inter-domain discrepancy of the conditional distributions of the feature given the label. Besides, it is imposed by the constraints from the adversarial learning and feedback mechanism to enhance the condition invariant feature representation. The extensive experiments on two datasets demonstrate the effectiveness of our approach, as well as the state-of-the-art performance comparing with thirteen methods.
引用
收藏
页码:3081 / 3093
页数:13
相关论文
共 82 条
[1]  
Balaji Y, 2018, ADV NEUR IN, V31
[2]  
Cao ALXD, 2020, Arxiv, DOI arXiv:2006.02003
[3]   Domain Generalization by Solving Jigsaw Puzzles [J].
Carlucci, Fabio M. ;
D'Innocente, Antonio ;
Bucci, Silvia ;
Caputo, Barbara ;
Tommasi, Tatiana .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2224-2233
[4]   Human Pose Estimation with Iterative Error Feedback [J].
Carreira, Joao ;
Agrawal, Pulkit ;
Fragkiadaki, Katerina ;
Malik, Jitendra .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4733-4742
[5]   Problem formulations and solvers in linear SVM: a review [J].
Chauhan, Vinod Kumar ;
Dahiya, Kalpana ;
Sharma, Anuj .
ARTIFICIAL INTELLIGENCE REVIEW, 2019, 52 (02) :803-855
[6]   A trusted medical image super-resolution method based on feedback adaptive weighted dense network [J].
Chen, Lihui ;
Yang, Xiaomin ;
Jeon, Gwanggil ;
Anisetti, Marco ;
Liu, Kai .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2020, 106
[7]   Neighborhood Geometric Structure-Preserving Variational Autoencoder for Smooth and Bounded Data Sources [J].
Chen, Xingyu ;
Wang, Chunyu ;
Lan, Xuguang ;
Zheng, Nanning ;
Zeng, Wenjun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) :3598-3611
[8]   Denoising Adversarial Autoencoders [J].
Creswell, Antonia ;
Bharath, Anil Anthony .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (04) :968-984
[9]   Soft-IntroVAE: Analyzing and Improving the Introspective Variational Autoencoder [J].
Daniel, Tal ;
Tamar, Aviv .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4389-4398
[10]  
Diederik P., P ICLR 2015