Double negative sampled graph adversarial representation learning with motif-based structural attention network

被引:0
作者
Zhang, Yinglong [1 ]
Yang, Shangying [1 ]
Kong, Mingyue [1 ]
Xia, Xuewen [1 ]
Xu, Xing [1 ]
机构
[1] Minnan Normal Univ, Sch Phys & Informat Engn, Zhangzhou 363000, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks; Generative adversarial networks; Motif; Graph representation learning;
D O I
10.1016/j.neucom.2024.129030
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, graph neural networks have achieved remarkable performance in various downstream tasks by aggregating node neighborhoods hierarchically. However, prior methods usually treat neighboring nodes equally based solely on graph structure or rely on feature similarity for neighborhood aggregation, thereby underutilizing the integrated structural and attribute information. Inspired by the adversarial training mechanism, we propose a Double Negative sampled generative Adversarial network with Motif-based Structural Attention Network ( DNA-MSAN ), a novel framework for graph representation learning. Our method enhances the discriminator's capability to distinguish between positive and negative samples by preserving the original graph's motif-based higher-order structure and effectively learning node attribute information. Specifically, we first introduce an attention network based on the higher-order connectivity of motifs, which preserves the higher-order connectivity by perceiving motifs in the graph and using a normalized motif adjacency matrix for neighborhood aggregation. Next, we design a double negative sampling strategy, which cleverly introduces a negative sampling approach based on the current parameters of the discriminator to obtain additional negative samples, serving as useful supplementary samples to those generated by the generator. For the generator, we implement a local graph softmax that significantly optimizes the time complexity of traditional graph softmax by restricting the depth of breadth-first search traversal, leading to marked improvements in model performance. We evaluate DNA-MSAN on link prediction, node classification, and visualization tasks across five datasets, demonstrating substantial advancements in performance across multiple downstream tasks.
引用
收藏
页数:15
相关论文
共 59 条
[1]   Disease gene classification with metagraph representations [J].
Ata, Sezin Kircali ;
Fang, Yuan ;
Wu, Min ;
Li, Xiao-Li ;
Xiao, Xiaokui .
METHODS, 2017, 131 :83-92
[2]   Graph convolutional network combining node similarity association and layer attention for personalized recommendation [J].
Cai, Linqin ;
Lai, Tingjie ;
Wang, Lingjun ;
Zhou, Yanan ;
Xiong, Yu .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121
[3]   A review: Knowledge reasoning over knowledge graph [J].
Chen, Xiaojun ;
Jia, Shengbin ;
Xiang, Yang .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 141
[4]   Motif Graph Neural Network [J].
Chen, Xuexin ;
Cai, Ruichu ;
Fang, Yuan ;
Wu, Min ;
Li, Zijian ;
Hao, Zhifeng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) :14833-14847
[5]   Hierarchical graph representation learning for the prediction of drug-target binding affinity [J].
Chu, Zhaoyang ;
Huang, Feng ;
Fu, Haitao ;
Quan, Yuan ;
Zhou, Xionghui ;
Liu, Shichao ;
Zhang, Wen .
INFORMATION SCIENCES, 2022, 613 :507-523
[6]   Graph Adversarial Training: Dynamically Regularizing Based on Graph Structure [J].
Feng, Fuli ;
He, Xiangnan ;
Tang, Jie ;
Chua, Tat-Seng .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2021, 33 (06) :2493-2504
[7]   ARIEL: Adversarial Graph Contrastive Learning [J].
Feng, Shengyu ;
Jing, Baoyu ;
Zhu, Yada ;
Tong, Hanghang .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (04)
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   node2vec: Scalable Feature Learning for Networks [J].
Grover, Aditya ;
Leskovec, Jure .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :855-864
[10]  
Hamilton WL, 2017, ADV NEUR IN, V30