Probing Negative Sampling for Contrastive Learning to Learn Graph Representations

被引:0
作者
Chen, Shiyi [1 ]
Wang, Ziao [1 ]
Zhang, Xinni [1 ]
Zhang, Xiaofeng [1 ]
Peng, Dan [1 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Comp Sci, Shenzhen, Peoples R China
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2021: RESEARCH TRACK, PT II | 2021年 / 12976卷
基金
中国国家自然科学基金;
关键词
Graph neural network; Contrastive learning; Negative sampling;
D O I
10.1007/978-3-030-86520-7_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph representation learning has long been an important yet challenging task for various real-world applications. However, its downstream tasks are mainly performed in the settings of supervised or semi-supervised learning. Inspired by recent advances in unsupervised contrastive learning, this paper is thus motivated to investigate how the node-wise contrastive learning could be performed. Particularly, we respectively resolve the class collision issue and the imbalanced negative data distribution issue. Extensive experiments are performed on three real-world datasets and the proposed approach achieves the SOTA model performance.
引用
收藏
页码:434 / 449
页数:16
相关论文
共 33 条
  • [1] Abu-El-Haija S, 2019, ICML, P21
  • [2] [Anonymous], 2010, JMLR WORKSHOP C P
  • [3] Shortest-path kernels on graphs
    Borgwardt, KM
    Kriegel, HP
    [J]. Fifth IEEE International Conference on Data Mining, Proceedings, 2005, : 74 - 81
  • [4] How Do the Open Source Communities Address Usability and UX Issues? An Exploratory Study
    Cheng, Jinghui
    Guo, Jin L. C.
    [J]. CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [5] ckovic P., 2018, INT C LEARN REPR
  • [6] Defferrard M, 2016, ADV NEUR IN, V29
  • [7] Fedus W., 2019, INT C LEARN REPR
  • [8] Glorot X., 2011, P 14 INT C ART INT S, P315, DOI DOI 10.1002/ECS2.1832
  • [9] node2vec: Scalable Feature Learning for Networks
    Grover, Aditya
    Leskovec, Jure
    [J]. KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, : 855 - 864
  • [10] Hamilton William L, 2017, Advances in neural information processing systems, P1025