ADAPTIVE MULTI-VIEW JOINT CONTRASTIVE LEARNING ON GRAPHS

被引:0
|
作者
Chen, Long [1 ]
Ren, Qianqian [1 ]
Li, Zilong [1 ]
Xu, Hui [1 ]
机构
[1] Heilongjiang Univ, Dept Comp Sci & Technol, Harbin, Heilongjiang, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024 | 2024年
关键词
Contrastive learning; self-supervised learning; graph augmentation; graph representation;
D O I
10.1109/ICASSP48485.2024.10447431
中图分类号
学科分类号
摘要
Recently, contrastive learning has shown promising results for representing graphs. Despite their success, several key issues have not been well addressed in existing studies: 1) Data noise and incompleteness are inevitable in the graph signal due to various factors. 2) Improper augmentation strategies may have negative effects on views construction and graph representation. In this study, we propose a novel joint contrastive learning model for graph representation named MVJCL. Specifically, a set of views were constructed with topology-level and node-level augmentation strategies. For each view, we execute two-layers GCNs to learn the node embeddings. Then, we propose a positive-negative-positive (pnp) contrastive learning task, which performs contrastive learning between the negative view and each positive view, so as alleviate the noise of supervision signal and exploit the most critical information. Extensive experiments on five real-world datasets demonstrate the effectiveness of MVJCL, where the maximum improvement can reach to 4.63%.
引用
收藏
页码:5860 / 5864
页数:5
相关论文
共 50 条
  • [1] Contrastive Multi-View Representation Learning on Graphs
    Hassani, Kaveh
    Khasahmadi, Amir Hosein
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [2] MUSE: Multi-View Contrastive Learning for Heterophilic Graphs
    Yuan, Mengyi
    Chen, Minjie
    Li, Xiang
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3094 - 3103
  • [3] Multi-view Document Clustering with Joint Contrastive Learning
    Bai, Ruina
    Huang, Ruizhang
    Qin, Yongbin
    Chen, Yanping
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 706 - 719
  • [4] Learning Contrastive Multi-View Graphs for Recommendation (Student Abstract)
    Cheng, Zhangtao
    Zhong, Ting
    Zhang, Kunpeng
    Walker, Joojo
    Zhou, Fan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 12927 - 12928
  • [5] Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs
    Hu, Zhiwei
    Gutierrez-Basulto, Victor
    Xiang, Zhiliang
    Li, Ru
    Pan, Jeff Z.
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 12950 - 12963
  • [6] Contrastive Multi-View Kernel Learning
    Liu, Jiyuan
    Liu, Xinwang
    Yang, Yuexiang
    Liao, Qing
    Xia, Yuanqing
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9552 - 9566
  • [7] Multi-view dreaming: multi-view world model with contrastive learning
    Kinose A.
    Okumura R.
    Okada M.
    Taniguchi T.
    Advanced Robotics, 2023, 37 (19) : 1212 - 1220
  • [8] Joint contrastive triple-learning for deep multi-view clustering
    Hu, Shizhe
    Zou, Guoliang
    Zhang, Chaoyang
    Lou, Zhengzheng
    Geng, Ruilin
    Ye, Yangdong
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (03)
  • [9] AdaMCL: Adaptive Fusion Multi-View Contrastive Learning for Collaborative Filtering
    Zhu, Guanghui
    Lu, Wang
    Yuan, Chunfeng
    Huang, Yihua
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 1076 - 1085
  • [10] Dual contrastive learning for multi-view clustering
    Bao, Yichen
    Zhao, Wenhui
    Zhao, Qin
    Gao, Quanxue
    Yang, Ming
    NEUROCOMPUTING, 2024, 599