Enhancing graph convolutional networks with progressive granular ball sampling fusion: A novel approach to efficient and accurate GCN training

被引:2
作者
Cong, Hui [1 ]
Sun, Qiguo [1 ]
Yang, Xibei [1 ]
Liu, Keyu [1 ]
Qian, Yuhua [2 ]
机构
[1] Jiangsu Univ Sci & Technol, Sch Comp, Zhenjiang 212100, Jiangsu, Peoples R China
[2] Shanxi Univ, Inst Big Data Sci & Ind, Taiyuan 030006, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Granular-ball sampling; Graph convolutional networks; Incremental training; Node classification; Semi-supervised learning; CLASSIFICATION;
D O I
10.1016/j.ins.2024.120831
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph convolutional network (GCN) has gained considerable attention and has been widely utilized in graph data analytics. However, training large GCNs presents considerable challenges owing to the inherent complexity of graph -structured data. Previous training algorithms frequently struggle with slow convergence speed caused by full -batch gradient descent on entire graphs and reduced model performance due to inappropriate node sampling methods. To address these issues, we propose a novel framework called Progressive Granular Ball Sampling Fusion (PGBSF). PGBSF leverages granular ball sampling to partition the original graph into a collection of subgraphs, thereby enhancing both training efficiency and detail capture. Then, it applies a progressive approach accompanied by a parameter -sharing strategy for incremental GCN model training, which results in robust performance and rapid convergence speed. This simple yet effective strategy considerably enhances classification accuracy and memory efficiency. The experiment results show that our proposed architecture consistently outperforms other baseline models in terms of accuracy across almost all datasets with different label rates. In addition, PGBSF improves GCN performance significantly on large and complex datasets. Moreover, GCN+PGBSF reduces time complexity by training on subgraphs and achieves the fastest convergence speed among all models, with a relatively small variance in loss during training.
引用
收藏
页数:14
相关论文
共 47 条
  • [1] Gift: granularity over specific-class for feature selection
    Ba, Jing
    Liu, Keyu
    Yang, Xibei
    Qian, Yuhua
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (10) : 12201 - 12232
  • [2] MG-GCN: A Scalable multi-GPU GCN Training Framework
    Balin, Muhammed Fatih
    Sancak, Kaan
    Catalyurekt, Umit V.
    [J]. 51ST INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2022, 2022,
  • [3] PKET-GCN: Prior knowledge enhanced time-varying graph convolution network for traffic flow prediction
    Bao, Yinxin
    Liu, Jiali
    Shen, Qinqin
    Cao, Yang
    Ding, Weiping
    Shi, Quan
    [J]. INFORMATION SCIENCES, 2023, 634 : 359 - 381
  • [4] Chen M, 2020, PR MACH LEARN RES, V119
  • [5] Random sampling accelerator for attribute reduction
    Chen, Zhen
    Liu, Keyu
    Yang, Xibei
    Fujita, Hamido
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2022, 140 : 75 - 91
  • [6] A Fast Granular-Ball-Based Density Peaks Clustering Algorithm for Large-Scale Data
    Cheng, Dongdong
    Li, Ya
    Xia, Shuyin
    Wang, Guoyin
    Huang, Jinlong
    Zhang, Sulan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 17202 - 17215
  • [7] How Do the Open Source Communities Address Usability and UX Issues? An Exploratory Study
    Cheng, Jinghui
    Guo, Jin L. C.
    [J]. CHI 2018: EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2018,
  • [8] Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks
    Chiang, Wei-Lin
    Liu, Xuanqing
    Si, Si
    Li, Yang
    Bengio, Samy
    Hsieh, Cho-Jui
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 257 - 266
  • [9] HesGCN: Hessian graph convolutional networks for semi-supervised classification
    Fu, Sichao
    Liu, Weifeng
    Tao, Dapeng
    Zhou, Yicong
    Nie, Liqiang
    [J]. INFORMATION SCIENCES, 2020, 514 : 484 - 498
  • [10] Graph U-Nets
    Gao, Hongyang
    Ji, Shuiwang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4948 - 4960