A Fast and Robust Attention-Free Heterogeneous Graph Convolutional Network

被引:0
|
作者
Yan, Yeyu [1 ]
Zhao, Zhongying [2 ]
Yang, Zhan [2 ]
Yu, Yanwei [3 ]
Li, Chao [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect & Informat Engn, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[3] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266005, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Semantics; Topology; Robustness; Micromechanical devices; Virtual links; Attention mechanism; graph neural network; heterogeneous graph; heterogeneous graph neural network;
D O I
10.1109/TBDATA.2024.3375152
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the widespread applications of heterogeneous graphs in the real world, heterogeneous graph neural networks (HGNNs) have developed rapidly and made a great success in recent years. To effectively capture the complex interactions in heterogeneous graphs, various attention mechanisms are widely used in designing HGNNs. However, the employment of these attention mechanisms brings two key problems: high computational complexity and poor robustness. To address these problems, we propose a Fast and Robust attention-free Heterogeneous Graph Convolutional Network (FastRo-HGCN) without any attention mechanisms. Specifically, we first construct virtual links based on the topology similarity and feature similarity of the nodes to strengthen the connections between the target nodes. Then, we design type normalization to aggregate and transfer the intra-type and inter-type node information. The above methods are used to reduce the interference of noisy information. Finally, we further enhance the robustness and relieve the negative effects of oversmoothing with the self-loops of nodes. Extensive experimental results on three real-world datasets fully demonstrate that the proposed FastRo-HGCN significantly outperforms the state-of-the-art models.
引用
收藏
页码:669 / 681
页数:13
相关论文
共 50 条
  • [31] Graph convolutional network combined with random walks and graph attention network for node classification
    Yong, Chen
    Xiaozhu, Xie
    Wei, Weng
    Journal of China Universities of Posts and Telecommunications, 2024, 31 (03): : 1 - 14
  • [32] Graph convolutional network combined with random walks and graph attention network for node classification
    Chen Yong
    Xie Xiaozhu
    Weng Wei
    The Journal of China Universities of Posts and Telecommunications, 2024, 31 (03) : 1 - 14
  • [33] MHGCN plus : Multiplex Heterogeneous Graph Convolutional Network
    Fu, Chaofan
    Yu, Pengyang
    Yu, Yanwei
    Huang, Chao
    Zhao, Zhongying
    Dong, Junyu
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (03)
  • [34] Chinese word segmentation with heterogeneous graph convolutional network
    Tang, Xuemei
    Su, Qi
    Wang, Jun
    NATURAL LANGUAGE PROCESSING, 2024,
  • [35] Multimodal heterogeneous graph convolutional network for image recommendation
    Wei, Weiyi
    Wang, Jian
    Xu, Mengyu
    Zhang, Futong
    MULTIMEDIA SYSTEMS, 2023, 29 (5) : 2747 - 2760
  • [36] An improved heterogeneous graph convolutional network for job recommendation
    Wang, Hao
    Yang, Wenchuan
    Li, Jichao
    Ou, Junwei
    Song, Yanjie
    Chen, Yingwu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [37] Heterogeneous Attributed Network Embedding with Graph Convolutional Networks
    Wang, Yueyang
    Duan, Ziheng
    Liao, Binbing
    Wu, Fei
    Zhuang, Yueting
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10061 - 10062
  • [38] Heterogeneous Graph Convolutional Network Based on Correlation Matrix
    Qiu, Liqing
    Zhou, Jingcheng
    Jing, Caixia
    Liu, Yuying
    BIG DATA RESEARCH, 2023, 32
  • [39] Multimodal heterogeneous graph convolutional network for image recommendation
    Weiyi Wei
    Jian Wang
    Mengyu Xu
    Futong Zhang
    Multimedia Systems, 2023, 29 : 2747 - 2760
  • [40] Gated graph convolutional network with enhanced representation and joint attention for distant supervised heterogeneous relation extraction
    Xiang Ying
    Zechen Meng
    Mankun Zhao
    Mei Yu
    Shirui Pan
    Xuewei Li
    World Wide Web, 2023, 26 : 401 - 420