A Fast and Robust Attention-Free Heterogeneous Graph Convolutional Network

被引:0
|
作者
Yan, Yeyu [1 ]
Zhao, Zhongying [2 ]
Yang, Zhan [2 ]
Yu, Yanwei [3 ]
Li, Chao [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect & Informat Engn, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[3] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266005, Peoples R China
基金
中国国家自然科学基金;
关键词
Computational modeling; Semantics; Topology; Robustness; Micromechanical devices; Virtual links; Attention mechanism; graph neural network; heterogeneous graph; heterogeneous graph neural network;
D O I
10.1109/TBDATA.2024.3375152
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the widespread applications of heterogeneous graphs in the real world, heterogeneous graph neural networks (HGNNs) have developed rapidly and made a great success in recent years. To effectively capture the complex interactions in heterogeneous graphs, various attention mechanisms are widely used in designing HGNNs. However, the employment of these attention mechanisms brings two key problems: high computational complexity and poor robustness. To address these problems, we propose a Fast and Robust attention-free Heterogeneous Graph Convolutional Network (FastRo-HGCN) without any attention mechanisms. Specifically, we first construct virtual links based on the topology similarity and feature similarity of the nodes to strengthen the connections between the target nodes. Then, we design type normalization to aggregate and transfer the intra-type and inter-type node information. The above methods are used to reduce the interference of noisy information. Finally, we further enhance the robustness and relieve the negative effects of oversmoothing with the self-loops of nodes. Extensive experimental results on three real-world datasets fully demonstrate that the proposed FastRo-HGCN significantly outperforms the state-of-the-art models.
引用
收藏
页码:669 / 681
页数:13
相关论文
共 50 条
  • [41] Gated graph convolutional network with enhanced representation and joint attention for distant supervised heterogeneous relation extraction
    Ying, Xiang
    Meng, Zechen
    Zhao, Mankun
    Yu, Mei
    Pan, Shirui
    Li, Xuewei
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (01): : 401 - 420
  • [42] SE-Mixer: Towards an Efficient Attention-free Neural Network for Speech Enhancement
    Wang, Kai
    He, Bengbeng
    Zhu, Wei-Ping
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 300 - 306
  • [43] Power up! Robust Graph Convolutional Network via Graph Powering
    Jin, Ming
    Chang, Heng
    Zhu, Wenwu
    Sojoudi, Somayeh
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8004 - 8012
  • [44] Adaptive Neighbor Graph Aggregated Graph Attention Network for Heterogeneous Graph Embedding
    Lin Kaibiao
    Chen, Jinpo
    Chen Ruicong
    Fan, Yang
    Yang, Zhang
    Min, Lin
    Ping, Lu
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (01)
  • [45] Adaptive Neighbor Graph Aggregated Graph Attention Network for Heterogeneous Graph Embedding
    Kaibiao, Lin
    Chen, Jinpo
    Ruicong, Chen
    Fan, Yang
    Yang, Zhang
    Min, Lin
    Ping, Lu
    ACM Transactions on Knowledge Discovery from Data, 2022, 18 (01)
  • [46] Visual object categorization: is it indeed an attention-free process?
    Rosenberg, Y.
    Shachar, M.
    Gronau, N.
    JOURNAL OF MOLECULAR NEUROSCIENCE, 2012, 48 : S99 - S99
  • [47] Detecting collusive spammers with heterogeneous graph attention network
    Zhang, Fuzhi
    Wu, Jiayi
    Zhang, Peng
    Ma, Ru
    Yu, Hongtao
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (03)
  • [48] Multiagent Reinforcement Learning With Heterogeneous Graph Attention Network
    Du, Wei
    Ding, Shifei
    Zhang, Chenglong
    Shi, Zhongzhi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 6851 - 6860
  • [49] Attention-Aware Heterogeneous Graph Neural Network
    Zhang, Jintao
    Xu, Quan
    BIG DATA MINING AND ANALYTICS, 2021, 4 (04) : 233 - 241
  • [50] Exploiting Triangle Patterns for Heterogeneous Graph Attention Network
    Yi, Eunjeong
    Kim, Min-Soo
    ICWE 2021 WORKSHOPS, ICWE 2021 INTERNATIONAL WORKSHOPS, 2022, 1508 : 71 - 81