Multi-Relation Augmentation for Graph Neural Networks

被引:0
作者
Xiao, Shunxin [1 ,2 ]
Lin, Huibin [1 ,2 ]
Wang, Jianwen [1 ,2 ]
Qin, Xiaolong [3 ]
Wang, Shiping [1 ,2 ]
机构
[1] Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
[2] Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
[3] Hangzhou Normal Univ, Dept Math, Hangzhou 311121, Peoples R China
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 05期
基金
中国国家自然科学基金;
关键词
Task analysis; Graph neural networks; Data augmentation; Data models; Self-supervised learning; Training; Deep learning; graph neural network; data augmentation; semi-supervised learning; unsupervised learning;
D O I
10.1109/TETCI.2024.3371214
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data augmentation has been successfully utilized to refine the generalization capability and performance of learning algorithms in image and text analysis. With the rising focus on graph neural networks, an increasing number of researchers are employing various data augmentation approaches to improve graph learning techniques. Although significant improvements have been made, most of them are implemented by manipulating nodes or edges to generate modified graphs as augmented views, which might lose the information hidden in the input data. To address this issue, we propose a simple but effective data augmentation framework termed multi-relation augmentation designed for existing graph neural networks. Different from prior works, the designed model utilizes various methods to simulate multiple adjacency relationships (multi-relation) among nodes as augmented views instead of manipulating the original graph. The proposed augmentation framework can be formulated as three sub-modules, each offering distinct advantages: 1) The encoder module and projection module form a shared contrastive learning framework for both the original graph and all augmented views. Due to the shared mechanism, the proposed method can be simply applied to various graph learning models. 2) The designed task-specific module flexibly extends the proposed framework for various machine learning tasks. Experimental results on several databases show that the introduced augmentation framework improves the performance of existing graph neural networks on both semi-supervised node classification and unsupervised clustering tasks. It demonstrates that multiple relations mechanism is efficient for graph-based augmentation.
引用
收藏
页码:3614 / 3627
页数:14
相关论文
共 50 条
[31]   Multi-relation graph convolutional network for Alzheimer's disease diagnosis using structural MRI [J].
Zhang, Jin ;
He, Xiaohai ;
Qing, Linbo ;
Chen, Xiang ;
Liu, Yan ;
Chen, Honggang .
KNOWLEDGE-BASED SYSTEMS, 2023, 270
[32]   MREGDN: Multi-Relation Enhanced Graph Disentangled Network for semi-supervised node classification [J].
Liu, Xinxin ;
Yu, Weiren .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
[33]   Reverse Graph Learning for Graph Neural Network [J].
Peng, Liang ;
Hu, Rongyao ;
Kong, Fei ;
Gan, Jiangzhang ;
Mo, Yujie ;
Shi, Xiaoshuang ;
Zhu, Xiaofeng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) :4530-4541
[34]   On the Effectiveness of Heterogeneous Ensembles Combining Graph Neural Networks and Heuristics for Dynamic Link Prediction [J].
Skarding, Joakim ;
Gabrys, Bogdan ;
Musial, Katarzyna .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04) :3250-3259
[35]   Multichannel Adaptive Data Mixture Augmentation for Graph Neural Networks [J].
Ye, Zhonglin ;
Zhou, Lin ;
Li, Mingyuan ;
Zhang, Wei ;
Liu, Zhen ;
Zhao, Haixing .
INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2024, 20 (01)
[36]   Toward Subgraph-Guided Knowledge Graph Question Generation With Graph Neural Networks [J].
Chen, Yu ;
Wu, Lingfei ;
Zaki, Mohammed J. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) :12706-12717
[37]   Dual Fusion-Propagation Graph Neural Network for Multi-View Clustering [J].
Xiao, Shunxin ;
Du, Shide ;
Chen, Zhaoliang ;
Zhang, Yunhe ;
Wang, Shiping .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :9203-9215
[38]   On the Power of Graph Neural Networks and Feature Augmentation Strategies to Classify Social Networks [J].
Guettala, Walid ;
Gulyas, Laszlo .
INTELLIGENT INFORMATION AND DATABASE SYSTEMS, PT II, ACIIDS 2024, 2024, 14796 :287-301
[39]   GammaGL: A Multi-Backend Library for Graph Neural Networks [J].
Liu, Yaoqi ;
Yang, Cheng ;
Zhao, Tianyu ;
Han, Hui ;
Zhang, Siyuan ;
Wu, Jing ;
Zhou, Guangyu ;
Huang, Hai ;
Wang, Hui ;
Shi, Chuan .
PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, :2861-2870
[40]   Architectural Implications of Graph Neural Networks [J].
Zhang, Zhihui ;
Leng, Jingwen ;
Ma, Lingxiao ;
Miao, Youshan ;
Li, Chao ;
Guo, Minyi .
IEEE COMPUTER ARCHITECTURE LETTERS, 2020, 19 (01) :59-62