Self-supervised Consensus Representation Learning for Attributed Graph

被引:39
|
作者
Liu, Changshu [1 ]
Wen, Liangjian [2 ]
Kang, Zhao [1 ]
Luo, Guangchun [3 ]
Tian, Ling [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Beijing, Peoples R China
[2] Huawei Technol Co Ltd, Noahs Ark Lab, Beijing, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Software Engn, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
关键词
self-supervised learning; semi-supervised classification; graph convolutional; network; CONVOLUTIONAL NETWORKS;
D O I
10.1145/3474085.3475416
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus Representation Learning (SCRL) framework. In contrast to most existing works that only explore one graph, our proposed SCRL method treats graph from two perspectives: topology graph and feature graph. We argue that their embeddings should share some common information, which could serve as a supervisory signal. Specifically, we construct the feature graph of node features via k-nearest neighbour algorithm. Then graph convolutional network (GCN) encoders extract features from two graphs respectively. Self-supervised loss is designed to maximize the agreement of the embeddings of the same node in the topology graph and the feature graph. Extensive experiments on real citation networks and social networks demonstrate the superiority of our proposed SCRL over the state-of-the-art methods on semi-supervised node classification task. Meanwhile, compared with its main competitors, SCRL is rather efficient. The source code is available at https://github.com/topgunlcs98/SCRL.
引用
收藏
页码:2654 / 2662
页数:9
相关论文
共 50 条
  • [1] Self-Supervised Contrastive Attributed Graph Joint Representation Clustering
    Wang, Jinghong
    Wang, Hui
    Computer Engineering and Applications, 2024, 60 (16) : 133 - 142
  • [2] Decoupling Anomaly Discrimination and Representation Learning: Self-supervised Learning for Anomaly Detection on Attributed Graph
    Hu, Yanming
    Chen, Chuan
    Deng, Bowen
    Lai, Yujing
    Lin, Hao
    Zheng, Zibin
    Bian, Jing
    DATA SCIENCE AND ENGINEERING, 2024, 9 (03) : 264 - 277
  • [3] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [4] Self-supervised Graph Representation Learning with Variational Inference
    Liao, Zihan
    Liang, Wenxin
    Liu, Han
    Mu, Jie
    Zhang, Xianchao
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 116 - 127
  • [5] Self-supervised graph representation learning via bootstrapping
    Che, Feihu
    Yang, Guohua
    Zhang, Dawei
    Tao, Jianhua
    Liu, Tong
    NEUROCOMPUTING, 2021, 456 (456) : 88 - 96
  • [6] Simple Self-supervised Multiplex Graph Representation Learning
    Mo, Yujie
    Chen, Yuhuan
    Peng, Liang
    Shi, Xiaoshuang
    Zhu, Xiaofeng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3301 - 3309
  • [7] Self-Supervised Representation Learning via Latent Graph Prediction
    Xie, Yaochen
    Xu, Zhao
    Ji, Shuiwang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [8] Self-Supervised Graph Representation Learning via Topology Transformations
    Gao, Xiang
    Hu, Wei
    Qi, Guo-Jun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4202 - 4215
  • [9] Generative Subgraph Contrast for Self-Supervised Graph Representation Learning
    Han, Yuehui
    Hui, Le
    Jiang, Haobo
    Qian, Jianjun
    Xie, Jin
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 91 - 107
  • [10] Self-Supervised Graph Representation Learning via Information Bottleneck
    Gu, Junhua
    Zheng, Zichen
    Zhou, Wenmiao
    Zhang, Yajuan
    Lu, Zhengjun
    Yang, Liang
    SYMMETRY-BASEL, 2022, 14 (04):