Multi-Relation Augmentation for Graph Neural Networks

被引:0
作者
Xiao, Shunxin [1 ,2 ]
Lin, Huibin [1 ,2 ]
Wang, Jianwen [1 ,2 ]
Qin, Xiaolong [3 ]
Wang, Shiping [1 ,2 ]
机构
[1] Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
[2] Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
[3] Hangzhou Normal Univ, Dept Math, Hangzhou 311121, Peoples R China
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 05期
基金
中国国家自然科学基金;
关键词
Task analysis; Graph neural networks; Data augmentation; Data models; Self-supervised learning; Training; Deep learning; graph neural network; data augmentation; semi-supervised learning; unsupervised learning;
D O I
10.1109/TETCI.2024.3371214
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data augmentation has been successfully utilized to refine the generalization capability and performance of learning algorithms in image and text analysis. With the rising focus on graph neural networks, an increasing number of researchers are employing various data augmentation approaches to improve graph learning techniques. Although significant improvements have been made, most of them are implemented by manipulating nodes or edges to generate modified graphs as augmented views, which might lose the information hidden in the input data. To address this issue, we propose a simple but effective data augmentation framework termed multi-relation augmentation designed for existing graph neural networks. Different from prior works, the designed model utilizes various methods to simulate multiple adjacency relationships (multi-relation) among nodes as augmented views instead of manipulating the original graph. The proposed augmentation framework can be formulated as three sub-modules, each offering distinct advantages: 1) The encoder module and projection module form a shared contrastive learning framework for both the original graph and all augmented views. Due to the shared mechanism, the proposed method can be simply applied to various graph learning models. 2) The designed task-specific module flexibly extends the proposed framework for various machine learning tasks. Experimental results on several databases show that the introduced augmentation framework improves the performance of existing graph neural networks on both semi-supervised node classification and unsupervised clustering tasks. It demonstrates that multiple relations mechanism is efficient for graph-based augmentation.
引用
收藏
页码:3614 / 3627
页数:14
相关论文
共 50 条
[21]   Integrating Multi-Label Contrastive Learning With Dual Adversarial Graph Neural Networks for Cross-Modal Retrieval [J].
Qian, Shengsheng ;
Xue, Dizhan ;
Fang, Quan ;
Xu, Changsheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) :4794-4811
[22]   GAFExplainer: Global View Explanation of Graph Neural Networks Through Attribute Augmentation and Fusion Embedding [J].
Hu, Wenya ;
Wu, Jia ;
Qian, Quan .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (05) :2569-2583
[23]   Multidimensional Graph Neural Networks for Wireless Communications [J].
Liu, Shengjie ;
Guo, Jia ;
Yang, Chenyang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (04) :3057-3073
[24]   Differentially Private Graph Neural Networks for Whole-Graph Classification [J].
Mueller, Tamara T. ;
Paetzold, Johannes C. ;
Prabhakar, Chinmay ;
Usynin, Dmitrii ;
Rueckert, Daniel ;
Kaissis, Georgios .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) :7308-7318
[25]   KAFNN: A Knowledge Augmentation Framework to Graph Neural Networks [J].
Tang, Bisheng ;
Chen, Xiaojun ;
Wang, Dakui ;
Zhao, Zhendong .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[26]   Graph Contrastive Learning With Adaptive Proximity-Based Graph Augmentation [J].
Zhuo, Wei ;
Tan, Guang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) :14301-14314
[27]   BGNN-XML: Bilateral Graph Neural Networks for Extreme Multi-Label Text Classification [J].
Zong, Daoming ;
Sun, Shiliang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (07) :6698-6709
[28]   A Comprehensive Survey of Graph Neural Networks for Knowledge Graphs [J].
Ye, Zi ;
Kumar, Yogan Jaya ;
Sing, Goh Ong ;
Song, Fengyan ;
Wang, Junsong .
IEEE ACCESS, 2022, 10 :75729-75741
[29]   Towards Inductive and Efficient Explanations for Graph Neural Networks [J].
Luo, Dongsheng ;
Zhao, Tianxiang ;
Cheng, Wei ;
Xu, Dongkuan ;
Han, Feng ;
Yu, Wenchao ;
Liu, Xiao ;
Chen, Haifeng ;
Zhang, Xiang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (08) :5245-5259
[30]   Multi-View Graph Neural Architecture Search for Biomedical Entity and Relation Extraction [J].
Al-Sabri, Raeed ;
Gao, Jianliang ;
Chen, Jiamin ;
Oloulade, Babatounde Moctard ;
Lyu, Tengfei .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2023, 20 (02) :1221-1233