Domain-Invariant Label Propagation With Adaptive Graph Regularization

被引:0
|
作者
Zhang, Yanning [1 ]
Tao, Jianwen [1 ]
Yan, Liangda [2 ]
机构
[1] Ningbo Polytech, Inst Artificial Intelligence Applicat, Ningbo 315800, Peoples R China
[2] Zhejiang Business Technol Inst, Sch Elect Informat, Ningbo 315012, Zhejiang, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Adaptation models; Optimization; Deep learning; Representation learning; Training; Knowledge transfer; Upper bound; Robustness; Predictive models; Noise measurement; Domain adaptation; maximum mean discrepancy; adaptive graph Laplacian; label propagation;
D O I
10.1109/ACCESS.2024.3510889
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an effective machine learning paradigm, domain adaptation (DA) learning aims to enhance the learning performance of the target domain by utilizing other relevant but distinct domain(s) (referred to as the source domain(s)). The existing mainstream methods for DA mainly learn discriminative domain-invariant feature representations by combining the "pseudo labels" of the target domain to better achieve knowledge transfer. However, most existing methods alternate the optimization learning of domain-invariant features and the updating of the "pseudo labels" into two different stages, which makes them difficult to achieve optimal learning performance. In order to achieve joint optimization learning of updating the "pseudo labels" and domain-invariant feature representations, a framework of Domain-Invariant Label prOpagation (DILO) with adaptive graph regularization is proposed. By combining semi-supervised knowledge adaptation and label propagation on domain data, DILO jointly optimizes domain-invariant feature representations and target learning tasks in a unified framework, allowing these two objectives to mutually benefit. Specifically, by introducing the concept of soft labels, a joint distribution measurement model is established to simultaneously alleviate both marginal and conditional distribution differences between different domains; constructing an adaptive probability graph model to enhance the robustness of label propagation. Moreover, a robust sigma -norm is applied to domain joint distribution measurement and inductive learning models to form a unified objective optimization formulation. An effective optimization algorithm is proposed for addressing the optimization problem of DILO. Compared with several representative DA methods, the proposed method achieved better or comparable robustness in adaptation learning on four cross-domain visual datasets.
引用
收藏
页码:190728 / 190745
页数:18
相关论文
共 50 条
  • [31] Adversarial Domain-Invariant Generalization: A Generic Domain-Regressive Framework for Bearing Fault Diagnosis Under Unseen Conditions
    Chen, Liang
    Li, Qi
    Shen, Changqing
    Zhu, Jun
    Wang, Dong
    Xia, Min
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (03) : 1790 - 1800
  • [32] Large-Scale Graph Label Propagation on GPUs
    Ye, Chang
    Li, Yuchen
    He, Bingsheng
    Li, Zhao
    Sun, Jianling
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (10) : 5234 - 5248
  • [33] Domain-invariant representation learning using an unsupervised domain adversarial adaptation deep neural network
    Jia, Xibin
    Jin, Ya
    Su, Xing
    Hu, Yongli
    NEUROCOMPUTING, 2019, 355 : 209 - 220
  • [34] Unsupervised Person Re-identification Based on Clustering and Domain-Invariant Network
    Huang, Yangru
    Jin, Yi
    Peng, Peixi
    Lang, Congyan
    Li, Yidong
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 517 - 528
  • [35] Domain-Invariant Few-Shot Contrastive Learning for Hyperspectral Image Classification
    Chen, Wenchen
    Zhang, Yanmei
    Chu, Jianping
    Wang, Xingbo
    Applied Sciences (Switzerland), 2024, 14 (23):
  • [36] Learning Domain-Invariant and Discriminative Features for Homogeneous Unsupervised Domain AdaptationInspec keywordsOther keywordsKey words
    Zhang, Yun
    Wang, Nianbin
    Cai, Shaobin
    CHINESE JOURNAL OF ELECTRONICS, 2020, 29 (06) : 1119 - 1125
  • [37] Learning emotion-discriminative and domain-invariant features for domain adaptation in speech emotion recognition
    Mao, Qirong
    Xu, Guopeng
    Xue, Wentao
    Gou, Jianping
    Zhan, Yongzhao
    SPEECH COMMUNICATION, 2017, 93 : 1 - 10
  • [38] Rolling bearing variable condition fault diagnosis method based on manifold embedding adaptive graph label propagation
    Zhao, Shubiao
    Wang, Guangbin
    Chen, Weiqiu
    Zhong, Zhixian
    Zeng, Dong
    Li, Can
    Chen, Jinhua
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (10)
  • [39] Discriminative Graph Embedding for Label Propagation
    Canh Hao Nguyen
    Mamitsuka, Hiroshi
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (09): : 1395 - 1405
  • [40] Domain-Invariant Progressive Knowledge Distillation for UAV-Based Object Detection
    Yao, Liang
    Liu, Fan
    Zhang, Chuanyi
    Ou, Zhiquan
    Wu, Ting
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22