MUSE: Multi-View Contrastive Learning for Heterophilic Graphs

被引:2
|
作者
Yuan, Mengyi [1 ]
Chen, Minjie [1 ]
Li, Xiang [1 ]
机构
[1] East China Normal Univ, Shanghai, Peoples R China
来源
PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Graph neural networks; representation learning; contrastive learning;
D O I
10.1145/3583780.3614985
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, self-supervised learning has emerged as a promising approach in addressing the issues of label dependency and poor generalization performance in traditional GNNs. However, existing self-supervised methods have limited effectiveness on heterophilic graphs, due to the homophily assumption that results in similar node representations for connected nodes. In this work, we propose a multi-view contrastive learning model for heterophilic graphs, namely, MUSE. Specifically, we construct two views to capture the information of the ego node and its neighborhood by GNNs enhanced with contrastive learning, respectively. Then we integrate the information from these two views to fuse the node representations. Fusion contrast is utilized to enhance the effectiveness of fused node representations. Further, considering that the influence of neighboring contextual information on information fusion may vary across different ego nodes, we employ an information fusion controller to model the diversity of node-neighborhood similarity at both the local and global levels. Finally, an alternating training scheme is adopted to ensure that unsupervised node representation learning and information fusion controller can mutually reinforce each other. We conduct extensive experiments to evaluate the performance of MUSE on 9 benchmark datasets. Our results show the effectiveness of MUSE on both node classification and clustering tasks. We provide our data and codes at https://github.com/dcxr969/MUSE.
引用
收藏
页码:3094 / 3103
页数:10
相关论文
共 50 条
  • [1] Contrastive Multi-View Representation Learning on Graphs
    Hassani, Kaveh
    Khasahmadi, Amir Hosein
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [2] ADAPTIVE MULTI-VIEW JOINT CONTRASTIVE LEARNING ON GRAPHS
    Chen, Long
    Ren, Qianqian
    Li, Zilong
    Xu, Hui
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 5860 - 5864
  • [3] Learning Contrastive Multi-View Graphs for Recommendation (Student Abstract)
    Cheng, Zhangtao
    Zhong, Ting
    Zhang, Kunpeng
    Walker, Joojo
    Zhou, Fan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 12927 - 12928
  • [4] Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs
    Hu, Zhiwei
    Gutierrez-Basulto, Victor
    Xiang, Zhiliang
    Li, Ru
    Pan, Jeff Z.
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 12950 - 12963
  • [5] Contrastive Multi-View Kernel Learning
    Liu, Jiyuan
    Liu, Xinwang
    Yang, Yuexiang
    Liao, Qing
    Xia, Yuanqing
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 9552 - 9566
  • [6] Multi-view dreaming: multi-view world model with contrastive learning
    Kinose A.
    Okumura R.
    Okada M.
    Taniguchi T.
    Advanced Robotics, 2023, 37 (19) : 1212 - 1220
  • [7] Dual contrastive learning for multi-view clustering
    Bao, Yichen
    Zhao, Wenhui
    Zhao, Qin
    Gao, Quanxue
    Yang, Ming
    NEUROCOMPUTING, 2024, 599
  • [8] Multi-view Contrastive Learning Network for Recommendation
    Bu, Xiya
    Ma, Ruixin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 319 - 330
  • [9] Multi-View Contrastive Learning from Demonstrations
    Correia, Andre
    Alexandre, Luis A.
    2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 338 - 344
  • [10] Heterogeneous Graph Contrastive Multi-view Learning
    Wang, Zehong
    Li, Qi
    Yu, Donghua
    Han, Xiaolong
    Gao, Xiao-Zhi
    Shen, Shigen
    PROCEEDINGS OF THE 2023 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2023, : 136 - 144