GRLC: Graph Representation Learning With Constraints

被引:40
作者
Peng, Liang [1 ,2 ]
Mo, Yujie [1 ,2 ]
Xu, Jie [1 ,2 ]
Shen, Jialie [3 ]
Shi, Xiaoshuang [1 ,2 ]
Li, Xiaoxiao [4 ]
Shen, Heng Tao [1 ,2 ]
Zhu, Xiaofeng [2 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Media, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Technol, Chengdu 611731, Peoples R China
[3] City Univ London, Dept Comp Sci, London EC1V 0HB, England
[4] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
[5] Guangxi Acad Sci, Nanning 530007, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Representation learning; Semantics; Self-supervised learning; Training; Mutual information; Computer science; Data mining; graph neural networks; graph representation learning; machine learning;
D O I
10.1109/TNNLS.2022.3230979
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contrastive learning has been successfully applied in unsupervised representation learning. However, the generalization ability of representation learning is limited by the fact that the loss of downstream tasks (e.g., classification) is rarely taken into account while designing contrastive methods. In this article, we propose a new contrastive-based unsupervised graph representation learning (UGRL) framework by 1) maximizing the mutual information (MI) between the semantic information and the structural information of the data and 2) designing three constraints to simultaneously consider the downstream tasks and the representation learning. As a result, our proposed method outputs robust low-dimensional representations. Experimental results on 11 public datasets demonstrate that our proposed method is superior over recent state-of-the-art methods in terms of different downstream tasks. Our code is available at https://github.com/LarryUESTC/GRLC.
引用
收藏
页码:8609 / 8622
页数:14
相关论文
共 64 条
[1]  
Arora S, 2019, PR MACH LEARN RES, V97
[2]  
Bojchevski A., 2018, ICLR
[3]  
Chen M, 2020, PR MACH LEARN RES, V119
[4]  
Chen T., 2020, Advances in neural information processing systems, P2020
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]  
Defferrard M, 2016, ADV NEUR IN, V29
[7]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[8]  
Du J., 2017, ARXIV
[9]   Multigraph Fusion for Dynamic Graph Convolutional Network [J].
Gan, Jiangzhang ;
Hu, Rongyao ;
Mo, Yujie ;
Kang, Zhao ;
Peng, Liang ;
Zhu, Yonghua ;
Zhu, Xiaofeng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) :196-207
[10]  
Gao TY, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P6894