Multi-level discriminator based contrastive learning for multiplex networks

被引:0
|
作者
Wu, Hongrun [1 ]
Zhang, Mingjie [2 ]
Xiang, Zhenglong [1 ,2 ,3 ,4 ]
Chen, Yingpin [1 ]
Yu, Fei [1 ]
Xia, Xuewen [1 ]
Li, Yuanxiang [1 ,2 ]
机构
[1] Minnan Normal Univ, Key Lab Intelligent Optimizat & Informat Proc, Zhangzhou 363000, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
关键词
Contrastive learning; Heterogeneous graphs; Multi-discriminator learning; Multiplex network embedding; PARTICLE SWARM OPTIMIZATION;
D O I
10.1016/j.neucom.2024.128754
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph embedding is a technique for obtaining low-dimensional representations of nodes across diverse networks, which may then be used for various downstream tasks and applications. When it applies to heterogeneous networks, it is hard to handle heterogeneous networks because they usually contain different types of nodes and edges with more semantic and structural information. Recently, contrastive learning has developed as the preferred strategy for dealing with unsupervised heterogeneous graph embedding to reduce the cost of human label annotation. However, most multi-view contrastive learning approaches calculate the model's loss only based on the mutual dependence between the node representation and graph representation. These approaches ignore that both node attributes and node clustering contain discriminative content. To solve this issue, we propose a model called Multi-Level Discriminator-based Contrastive Learning for Multiplex Networks (MLDCL). This model adopts a multi-level multi-discriminator-based approach that can simultaneously learn the globallevel structural information, node-level attribute information, and local-level clustering information. Moreover, an augmentation strategy in the contrast learning process from the spectral domain is proposed to improve the representation and discriminative ability of MLDCL. Numerous tests with node clustering and classification tasks on widely used datasets demonstrate the efficacy of the proposed approach.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] MITER: Medical Image-TExt joint adaptive pretRaining with multi-level contrastive learning
    Shu, Chang
    Zhu, Yi
    Tang, Xiaochu
    Xiao, Jing
    Chen, Youxin
    Li, Xiu
    Zhang, Qian
    Lu, Zheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [42] BiMGCL: rumor detection via bi- directional multi-level graph contrastive learning
    Feng, Weiwei
    Li, Yafang
    Li, Bo
    Jia, Zhibin
    Chu, Zhihua
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [43] Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System
    Zou, Ding
    Wei, Wei
    Mao, Xian-Ling
    Wang, Ziyang
    Qiu, Minghui
    Zhu, Feida
    Cao, Xin
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1358 - 1368
  • [44] A Multi-Level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference
    Li, Shu'ang
    Hu, Xuming
    Lin, Li
    Liu, Aiwei
    Wen, Lijie
    Yu, Philip S. S.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1771 - 1783
  • [45] Alleviating Exposure Bias via Multi-level Contrastive Learning and Deviation Simulation in Abstractive Summarization
    Xie, Jiawen
    Su, Qi
    Zhang, Shaoting
    Zhang, Xiaofan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 9732 - 9747
  • [46] BiMGCL: rumor detection via bi-directional multi-level graph contrastive learning
    Feng W.
    Li Y.
    Li B.
    Jia Z.
    Chu Z.
    PeerJ Computer Science, 2023, 9
  • [47] Denoising Multi-Level Cross-Attention and Contrastive Learning for Chest Radiology Report Generation
    Zhu, Deng
    Liu, Lijun
    Yang, Xiaobing
    Liu, Li
    Peng, Wei
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2025,
  • [48] CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion
    Jinyuan Liu
    Runjia Lin
    Guanyao Wu
    Risheng Liu
    Zhongxuan Luo
    Xin Fan
    International Journal of Computer Vision, 2024, 132 : 1748 - 1775
  • [49] CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion
    Liu, Jinyuan
    Lin, Runjia
    Wu, Guanyao
    Liu, Risheng
    Luo, Zhongxuan
    Fan, Xin
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (05) : 1748 - 1775
  • [50] A multi-level contrastive analysis of promotional strategies in specialised discourse
    Izquierdo, Marlen
    Perez Blanco, Maria
    ENGLISH FOR SPECIFIC PURPOSES, 2020, 58 : 43 - 57