SimGRL: a simple self-supervised graph representation learning framework via triplets

被引:0
|
作者
Da Huang
Fangyuan Lei
Xi Zeng
机构
[1] Guangdong Polytechnic Normal University,School of Electronic and Information
[2] Guang-dong Polytechnic Normal University,Guangdong Provincial Key Laboratory of Intellectual Property and Big Data
来源
Complex & Intelligent Systems | 2023年 / 9卷
关键词
Graph representation learning; Graph neural networks; Self-supervised learning; Triplet loss; Node classification; Graph classification;
D O I
暂无
中图分类号
学科分类号
摘要
Recently, graph contrastive learning (GCL) has achieved remarkable performance in graph representation learning. However, existing GCL methods usually follow a dual-channel encoder network (i.e., Siamese networks), which adds to the complexity of the network architecture. Additionally, these methods overly depend on varied data augmentation techniques, corrupting graph information. Furthermore, they are heavily reliant on large quantities of negative nodes for each object node, which requires tremendous memory costs. To address these issues, we propose a novel and simple graph representation learning framework, named SimGRL. Firstly, our proposed network architecture only contains one encoder based on a graph neural network instead of a dual-channel encoder, which simplifies the network architecture. Then we introduce a distributor to generate triplets to obtain the contrastive views between nodes and their neighbors, avoiding the need for data augmentations. Finally, we design a triplet loss based on adjacency information in graphs that utilizes only one negative node for each object node, reducing memory overhead significantly. Extensive experiments demonstrate that SimGRL achieves competitive performance on node classification and graph classification tasks, especially in terms of running time and memory overhead.
引用
收藏
页码:5049 / 5062
页数:13
相关论文
共 50 条
  • [1] SimGRL: a simple self-supervised graph representation learning framework via triplets
    Huang, Da
    Lei, Fangyuan
    Zeng, Xi
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5049 - 5062
  • [2] Simple Self-supervised Multiplex Graph Representation Learning
    Mo, Yujie
    Chen, Yuhuan
    Peng, Liang
    Shi, Xiaoshuang
    Zhu, Xiaofeng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3301 - 3309
  • [3] Self-supervised graph representation learning via bootstrapping
    Che, Feihu
    Yang, Guohua
    Zhang, Dawei
    Tao, Jianhua
    Liu, Tong
    NEUROCOMPUTING, 2021, 456 (456) : 88 - 96
  • [4] Self-Supervised Representation Learning via Latent Graph Prediction
    Xie, Yaochen
    Xu, Zhao
    Ji, Shuiwang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [5] Self-Supervised Graph Representation Learning via Topology Transformations
    Gao, Xiang
    Hu, Wei
    Qi, Guo-Jun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4202 - 4215
  • [6] Self-Supervised Graph Representation Learning via Information Bottleneck
    Gu, Junhua
    Zheng, Zichen
    Zhou, Wenmiao
    Zhang, Yajuan
    Lu, Zhengjun
    Yang, Liang
    SYMMETRY-BASEL, 2022, 14 (04):
  • [7] Self-supervised graph representation learning via positive mining
    Lee, Namkyeong
    Lee, Junseok
    Park, Chanyoung
    INFORMATION SCIENCES, 2022, 611 : 476 - 493
  • [8] Graph Barlow Twins: A self-supervised representation learning framework for graphs
    Bielak, Piotr
    Kajdanowicz, Tomasz
    Chawla, Nitesh V.
    KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [9] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [10] Self-supervised Consensus Representation Learning for Attributed Graph
    Liu, Changshu
    Wen, Liangjian
    Kang, Zhao
    Luo, Guangchun
    Tian, Ling
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2654 - 2662