Multi-Relation Augmentation for Graph Neural Networks

被引:0
作者
Xiao, Shunxin [1 ,2 ]
Lin, Huibin [1 ,2 ]
Wang, Jianwen [1 ,2 ]
Qin, Xiaolong [3 ]
Wang, Shiping [1 ,2 ]
机构
[1] Fuzhou Univ, Coll Comp & Data Sci, Fuzhou 350116, Peoples R China
[2] Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
[3] Hangzhou Normal Univ, Dept Math, Hangzhou 311121, Peoples R China
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 05期
基金
中国国家自然科学基金;
关键词
Task analysis; Graph neural networks; Data augmentation; Data models; Self-supervised learning; Training; Deep learning; graph neural network; data augmentation; semi-supervised learning; unsupervised learning;
D O I
10.1109/TETCI.2024.3371214
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data augmentation has been successfully utilized to refine the generalization capability and performance of learning algorithms in image and text analysis. With the rising focus on graph neural networks, an increasing number of researchers are employing various data augmentation approaches to improve graph learning techniques. Although significant improvements have been made, most of them are implemented by manipulating nodes or edges to generate modified graphs as augmented views, which might lose the information hidden in the input data. To address this issue, we propose a simple but effective data augmentation framework termed multi-relation augmentation designed for existing graph neural networks. Different from prior works, the designed model utilizes various methods to simulate multiple adjacency relationships (multi-relation) among nodes as augmented views instead of manipulating the original graph. The proposed augmentation framework can be formulated as three sub-modules, each offering distinct advantages: 1) The encoder module and projection module form a shared contrastive learning framework for both the original graph and all augmented views. Due to the shared mechanism, the proposed method can be simply applied to various graph learning models. 2) The designed task-specific module flexibly extends the proposed framework for various machine learning tasks. Experimental results on several databases show that the introduced augmentation framework improves the performance of existing graph neural networks on both semi-supervised node classification and unsupervised clustering tasks. It demonstrates that multiple relations mechanism is efficient for graph-based augmentation.
引用
收藏
页码:3614 / 3627
页数:14
相关论文
共 50 条
[41]   Linguistic Steganalysis With Graph Neural Networks [J].
Wu, Hanzhou ;
Yi, Biao ;
Ding, Feng ;
Feng, Guorui ;
Zhang, Xinpeng .
IEEE SIGNAL PROCESSING LETTERS, 2021, 28 :558-562
[42]   Graph Neural Networks in Network Neuroscience [J].
Bessadok, Alaa ;
Mahjoub, Mohamed Ali ;
Rekik, Islem .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) :5833-5848
[43]   Graph Neural Networks With Multiple Prior Knowledge for Multi-Omics Data Analysis [J].
Xiao, Shunxin ;
Lin, Huibin ;
Wang, Conghao ;
Wang, Shiping ;
Rajapakse, Jagath C. .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (09) :4591-4600
[44]   Hierarchical Graph Neural Networks for Few-Shot Learning [J].
Chen, Cen ;
Li, Kenli ;
Wei, Wei ;
Zhou, Joey Tianyi ;
Zeng, Zeng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (01) :240-252
[45]   Automatic Design of Deep Graph Neural Networks With Decoupled Mode [J].
Tao, Qian ;
Cai, Rongshen ;
Lin, Zicheng ;
Tang, Yufei .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
[46]   An Overview on the Application of Graph Neural Networks in Wireless Networks [J].
He, Shiwen ;
Xiong, Shaowen ;
Ou, Yeyu ;
Zhang, Jian ;
Wang, Jiaheng ;
Huang, Yongming ;
Zhang, Yaoxue .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 :2547-2565
[47]   Structure-Aware Multi-Hop Graph Convolution for Graph Neural Networks [J].
Li, Yang ;
Tanaka, Yuichi .
IEEE ACCESS, 2022, 10 :16624-16633
[48]   Contrastive Graph Convolutional Networks with adaptive augmentation for text classification [J].
Yang, Yintao ;
Miao, Rui ;
Wang, Yili ;
Wang, Xin .
INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (04)
[49]   Graph Neural Networks With Parallel Neighborhood Aggregations for Graph Classification [J].
Doshi, Siddhant ;
Chepuri, Sundeep Prabhakar .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2022, 70 :4883-4896
[50]   Revisiting Adversarial Attacks on Graph Neural Networks for Graph Classification [J].
Wang, Xin ;
Chang, Heng ;
Xie, Beini ;
Bian, Tian ;
Zhou, Shiji ;
Wang, Daixin ;
Zhang, Zhiqiang ;
Zhu, Wenwu .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (05) :2166-2178