A Fast and Robust Attention-Free Heterogeneous Graph Convolutional Network

被引:0
|
作者
Yan, Yeyu [1 ]
Zhao, Zhongying [2 ]
Yang, Zhan [2 ]
Yu, Yanwei [3 ]
Li, Chao [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect & Informat Engn, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[3] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266005, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Semantics; Topology; Robustness; Micromechanical devices; Virtual links; Attention mechanism; graph neural network; heterogeneous graph; heterogeneous graph neural network;
D O I
10.1109/TBDATA.2024.3375152
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the widespread applications of heterogeneous graphs in the real world, heterogeneous graph neural networks (HGNNs) have developed rapidly and made a great success in recent years. To effectively capture the complex interactions in heterogeneous graphs, various attention mechanisms are widely used in designing HGNNs. However, the employment of these attention mechanisms brings two key problems: high computational complexity and poor robustness. To address these problems, we propose a Fast and Robust attention-free Heterogeneous Graph Convolutional Network (FastRo-HGCN) without any attention mechanisms. Specifically, we first construct virtual links based on the topology similarity and feature similarity of the nodes to strengthen the connections between the target nodes. Then, we design type normalization to aggregate and transfer the intra-type and inter-type node information. The above methods are used to reduce the interference of noisy information. Finally, we further enhance the robustness and relieve the negative effects of oversmoothing with the self-loops of nodes. Extensive experimental results on three real-world datasets fully demonstrate that the proposed FastRo-HGCN significantly outperforms the state-of-the-art models.
引用
收藏
页码:669 / 681
页数:13
相关论文
共 50 条
  • [21] Attention-Free Global Multiscale Fusion Network for Remote Sensing Object Detection
    Gao, Tao
    Li, Ziqi
    Wen, Yuanbo
    Chen, Ting
    Niu, Qianqian
    Liu, Zixiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [22] Iconic memory is not a case of attention-free awareness
    Mack, Arien
    Erol, Muge
    Clarke, Jason
    CONSCIOUSNESS AND COGNITION, 2015, 33 : 291 - 299
  • [23] Spatio-Temporal-Frequency Graph Attention Convolutional Network for Aircraft Recognition Based on Heterogeneous Radar Network
    Meng, Han
    Peng, Yuexing
    Wang, Wenbo
    Cheng, Peng
    Li, Yonghui
    Xiang, Wei
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2022, 58 (06) : 5548 - 5559
  • [24] Heterogeneous graph attention network with motif clique
    Wang, Chenxu
    Luo, Minnan
    Peng, Zhen
    Dong, Yixiang
    Liu, Huaping
    NEUROCOMPUTING, 2023, 555
  • [25] SELECTOR: Heterogeneous graph network with convolutional masked autoencoder for multimodal robust prediction of cancer survival
    Pan L.
    Peng Y.
    Li Y.
    Wang X.
    Liu W.
    Xu L.
    Liang Q.
    Peng S.
    Computers in Biology and Medicine, 2024, 172
  • [26] Hazy Removal via Graph Convolutional with Attention Network
    Hu, Bin
    Yue, Zhuangzhuang
    Gu, Mingcen
    Zhang, Yan
    Xu, Zhen
    Li, Jinhang
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2023, 95 (04): : 517 - 527
  • [27] Learnable convolutional attention network for knowledge graph completion
    Shang, Bin
    Zhao, Yinliang
    Liu, Jun
    KNOWLEDGE-BASED SYSTEMS, 2024, 285
  • [28] An Attention Enhanced Graph Convolutional Network for Semantic Segmentation
    Chen, Ao
    Zhou, Yue
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2020, 2020, 12305 : 734 - 745
  • [29] Hazy Removal via Graph Convolutional with Attention Network
    Bin Hu
    Zhuangzhuang Yue
    Mingcen Gu
    Yan Zhang
    Zhen Xu
    Jinhang Li
    Journal of Signal Processing Systems, 2023, 95 : 517 - 527
  • [30] Dual Attention Graph Convolutional Network for Relation Extraction
    Zhang, Donghao
    Liu, Zhenyu
    Jia, Weiqiang
    Wu, Fei
    Liu, Hui
    Tan, Jianrong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (02) : 530 - 543