Hierarchical label with imbalance and attributed network structure fusion for network embedding

被引:3
作者
Zhao S. [1 ,2 ,3 ]
Chen J. [1 ,2 ,3 ]
Chen J. [1 ,2 ,3 ]
Zhang Y. [1 ,2 ,3 ]
Tang J. [4 ]
机构
[1] Key Laboratory of Intelligent Computing and Signal Processing, Ministry of Education, Hefei
[2] School of Computer Science and Technology, Anhui University, Hefei
[3] Information Materials and Intelligent Sensing Laboratory of Anhui Province, Hefei
[4] Department of Computer Science and Technology, Tsinghua University, Beijing
来源
AI Open | 2022年 / 3卷
基金
中国国家自然科学基金;
关键词
Attributed network embedding; Hierarchical label; Representation learning;
D O I
10.1016/j.aiopen.2022.07.002
中图分类号
学科分类号
摘要
Network embedding (NE) aims to learn low-dimensional vectors for nodes while preserving the network's essential properties (e.g., attributes and structure). Previous methods have been proposed to learn node representations with encouraging achievements. Recent research has shown that the hierarchical label has potential value in seeking latent hierarchical structures and learning more effective classification information. Nevertheless, most existing network embedding methods either focus on the network without the hierarchical label, or the learning process of hierarchical structure for labels is separate from the network structure. Learning node embedding with the hierarchical label suffers from two challenges: (1) Fusing hierarchical labels and network is still an arduous task. (2) The data volume imbalance under different hierarchical labels is more noticeable than flat labels. This paper proposes a Hierarchical Label and Attributed Network Structure Fusion model(HANS), which realizes the fusion of hierarchical labels and nodes through attributes and the attention-based fusion module. Particularly, HANS designs a directed hierarchy structure encoder for modeling label dependencies in three directions (parent–child, child–parent, and sibling) to strengthen the co-occurrence information between labels of different frequencies and reduce the impact of the label imbalance. Experiments on real-world datasets demonstrate that the proposed method achieves significantly better performance than the state-of-the-art algorithms. © 2022 The Authors
引用
收藏
页码:91 / 100
页数:9
相关论文
共 41 条
[1]  
Cao S., Lu W., Xu Q., Grarep: Learning graph representations with global structural information, Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 891-900, (2015)
[2]  
Cen Y., Zou X., Zhang J., Yang H., Zhou J., Tang J., Representation learning for attributed multiplex heterogeneous network, KDD, Anchorage, AK, USA, August 4-8, 2019, pp. 1358-1368, (2019)
[3]  
Chen B., Huang X., Xiao L., Cai Z., Jing L., Hyperbolic interaction model for hierarchical multi-label classification, The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, the Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, the Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, pp. 7496-7503, (2020)
[4]  
Chen M., Wei Z., Huang Z., Ding B., Li Y., Simple and deep graph convolutional networks, Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, Proceedings of Machine Learning Research, 119, pp. 1725-1735, (2020)
[5]  
Deng C., Zhao Z., Wang Y., Zhang Z., Feng Z., GraphZoom: A multi-level spectral approach for accurate and scalable graph embedding, 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, (2020)
[6]  
Ding C.H.Q., He X., Zha H., Gu M., Simon H.D., A min-max cut algorithm for graph partitioning and data clustering, Proceedings of the 2001 IEEE International Conference on Data Mining, pp. 107-114, (2001)
[7]  
Gao H., Huang H., Deep attributed network embedding, IJCAI, July 13-19, 2018, Stockholm, Sweden, pp. 3364-3370, (2018)
[8]  
Grady L., Random walks for image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., 28, 11, pp. 1768-1783, (2006)
[9]  
Grover A., Leskovec J., Node2vec: Scalable feature learning for networks, Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855-864, (2016)
[10]  
Hou Y., Chen H., Li C., Cheng J., pp. 65-73, (2019)