A Good View for Graph Contrastive Learning

被引:0
作者
Chen, Xueyuan [1 ]
Li, Shangzhe [2 ]
机构
[1] Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[2] Cent Univ Finance & Econ, Sch Stat & Math, Beijing 100081, Peoples R China
关键词
graph contrastive learning; coding tree representation; structural entropy; ENTROPY;
D O I
10.3390/e26030208
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Due to the success observed in deep neural networks with contrastive learning, there has been a notable surge in research interest in graph contrastive learning, primarily attributed to its superior performance in graphs with limited labeled data. Within contrastive learning, the selection of a "view" dictates the information captured by the representation, thereby influencing the model's performance. However, assessing the quality of information in these views poses challenges, and determining what constitutes a good view remains unclear. This paper addresses this issue by establishing the definition of a good view through the application of graph information bottleneck and structural entropy theories. Based on theoretical insights, we introduce CtrlGCL, a novel method for achieving a beneficial view in graph contrastive learning through coding tree representation learning. Extensive experiments were conducted to ascertain the effectiveness of the proposed view in unsupervised and semi-supervised learning. In particular, our approach, via CtrlGCL-H, yields an average accuracy enhancement of 1.06% under unsupervised learning when compared to GCL. This improvement underscores the efficacy of our proposed method.
引用
收藏
页数:18
相关论文
共 47 条
[1]   Sub2Vec: Feature Learning for Subgraphs [J].
Adhikari, Bijaya ;
Zhang, Yao ;
Ramakrishnan, Naren ;
Prakash, B. Aditya .
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT II, 2018, 10938 :170-182
[2]   Survey on Self-Supervised Learning: Auxiliary Pretext Tasks and Contrastive Learning Methods in Imaging [J].
Albelwi, Saleh .
ENTROPY, 2022, 24 (04)
[3]  
Annamalai N., 2017, P 13 INT WORKSHOP MI
[4]  
Baek J., 2021, P INT C LEARNING REP
[5]   Entropy of network ensembles [J].
Bianconi, Ginestra .
PHYSICAL REVIEW E, 2009, 79 (03)
[6]   The Laplacian of a graph as a density matrix: A basic combinatorial approach to separability of mixed states [J].
Braunstein, Samuel L. ;
Ghosh, Sibasish ;
Severini, Simone .
ANNALS OF COMBINATORICS, 2006, 10 (03) :291-317
[7]   Three great challenges for half-century-old computer science [J].
Brooks, FP .
JOURNAL OF THE ACM, 2003, 50 (01) :25-26
[8]  
Cai Xuheng, 2023, P 11 INT C LEARNING
[9]  
Chen T., 2020, PMLR, ppp 1597
[10]  
Cho K., 2014, ARXIV