A Fast and Robust Attention-Free Heterogeneous Graph Convolutional Network

被引:0
|
作者
Yan, Yeyu [1 ]
Zhao, Zhongying [2 ]
Yang, Zhan [2 ]
Yu, Yanwei [3 ]
Li, Chao [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect & Informat Engn, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[3] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266005, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Semantics; Topology; Robustness; Micromechanical devices; Virtual links; Attention mechanism; graph neural network; heterogeneous graph; heterogeneous graph neural network;
D O I
10.1109/TBDATA.2024.3375152
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the widespread applications of heterogeneous graphs in the real world, heterogeneous graph neural networks (HGNNs) have developed rapidly and made a great success in recent years. To effectively capture the complex interactions in heterogeneous graphs, various attention mechanisms are widely used in designing HGNNs. However, the employment of these attention mechanisms brings two key problems: high computational complexity and poor robustness. To address these problems, we propose a Fast and Robust attention-free Heterogeneous Graph Convolutional Network (FastRo-HGCN) without any attention mechanisms. Specifically, we first construct virtual links based on the topology similarity and feature similarity of the nodes to strengthen the connections between the target nodes. Then, we design type normalization to aggregate and transfer the intra-type and inter-type node information. The above methods are used to reduce the interference of noisy information. Finally, we further enhance the robustness and relieve the negative effects of oversmoothing with the self-loops of nodes. Extensive experimental results on three real-world datasets fully demonstrate that the proposed FastRo-HGCN significantly outperforms the state-of-the-art models.
引用
收藏
页码:669 / 681
页数:13
相关论文
共 50 条
  • [1] Heterogeneous Information Network Embedding with Convolutional Graph Attention Networks
    Cao, Meng
    Ma, Xiying
    Zhu, Kai
    Xu, Ming
    Wang, Chongjun
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Robust Clustering Model Based on Attention Mechanism and Graph Convolutional Network
    Xia, Hui
    Shao, Shushu
    Hu, Chunqiang
    Zhang, Rui
    Qiu, Tie
    Xiao, Fu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 5203 - 5215
  • [3] Facial Expression Recognition Method with Attention-Free Capsule Network
    Xu, Xuebin
    Liu, Chenguang
    Lu, Longbin
    Cao, Shuxin
    Xu, Zongyu
    Computer Engineering and Applications, 2023, 59 (22) : 251 - 258
  • [4] Heterogeneous Graph Attention Network
    Wang, Xiao
    Ji, Houye
    Shi, Chuan
    Wang, Bai
    Cui, Peng
    Yu, P.
    Ye, Yanfang
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 2022 - 2032
  • [5] A heterogeneous graph convolutional attention network method for classification of autism spectrum disorder
    Shao, Lizhen
    Fu, Cong
    Chen, Xunying
    BMC BIOINFORMATICS, 2023, 24 (01)
  • [6] A heterogeneous graph convolutional attention network method for classification of autism spectrum disorder
    Lizhen Shao
    Cong Fu
    Xunying Chen
    BMC Bioinformatics, 24
  • [7] Robust graph learning with graph convolutional network
    Wan, Yingying
    Yuan, Changan
    Zhan, Mengmeng
    Chen, Long
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (03)
  • [8] Multiplex Heterogeneous Graph Convolutional Network
    Yu, Pengyang
    Fu, Chaofan
    Yu, Yanwei
    Huang, Chao
    Zhao, Zhongying
    Dong, Junyu
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2377 - 2387
  • [9] Integrating Multimodal MRIs for Adult ADHD Identification with Heterogeneous Graph Attention Convolutional Network
    Yao, Dongren
    Yang, Erkun
    Sun, Li
    Sui, Jing
    Liu, Mingxia
    PREDICTIVE INTELLIGENCE IN MEDICINE, PRIME 2021, 2021, 12928 : 157 - 167
  • [10] Multimodal heterogeneous graph attention network
    Jia, Xiangen
    Jiang, Min
    Dong, Yihong
    Zhu, Feng
    Lin, Haocai
    Xin, Yu
    Chen, Huahui
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (04): : 3357 - 3372