Masked Graph Auto-Encoder Constrained Graph Pooling

被引:0
|
作者
Liu, Chuang [1 ]
Zhan, Yibing [2 ]
Ma, Xueqi [3 ]
Tao, Dapeng [4 ]
Du, Bo [1 ]
Hu, Wenbin [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
[2] JD Explore Acad, Beijing, Peoples R China
[3] Tsinghua Univ, Sch Software, Beijing, Peoples R China
[4] Yunnan Univ, Kunming, Yunnan, Peoples R China
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II | 2023年 / 13714卷
关键词
Graph Neural Nnetworks; Graph pooling; Graph auto-encoder; Graph classification;
D O I
10.1007/978-3-031-26390-3_23
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The node drop pooling is a significant type of graph pooling that is required for learning graph-level representations. However, existing node drop pooling models still suffer from the information loss problem, impairing their effectiveness in graph classification. To mitigate the detrimental effect of the information loss, we propose a novel and flexible technique called Masked Graph Auto-encoder constrained Pooling (MGAP), which enables vanilla node drop pooling methods to retain sufficient effective graph information from both node-attribute and network-topology perspectives. Specifically, MGAP reconstructs the original node attributes of the graph using a graph convolutional network and the node degree of the graph (i.e., structural information) using a feedforward neural network with exponential neurons from the pooled (masked) graphs generated by the vanilla node drop pooling models. Notably, MGAP is a plug-and-play technique that can be directly adopted in the current node drop pooling methods. To evaluate the effectiveness of MGAP, we conduct extensive experiments on eleven real-world datasets by applying MGAP to three commonly-used methods, i.e., TopKPool, SAGPool, and GSAPool. The experimental results reveal that MGAP has the capacity to consistently improve the performance of all the three node drop pooling models in the graph classification task.
引用
收藏
页码:377 / 393
页数:17
相关论文
共 50 条
  • [1] Contrastive graph auto-encoder for graph embedding
    Zu, Shuaishuai
    Li, Li
    Shen, Jun
    Tang, Weitao
    NEURAL NETWORKS, 2025, 187
  • [2] ProtoMGAE: Prototype-Aware Masked Graph Auto-Encoder for Graph Representation Learning
    Zheng, Yimei
    Jia, Caiyan
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (06)
  • [3] Embedding Graph Auto-Encoder for Graph Clustering
    Zhang, Hongyuan
    Li, Pei
    Zhang, Rui
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9352 - 9362
  • [4] GRAPH AUTO-ENCODER FOR GRAPH SIGNAL DENOISING
    Tien Huu Do
    Duc Minh Nguyen
    Deligiannis, Nikos
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3322 - 3326
  • [5] Wasserstein Graph Auto-Encoder
    Chu, Yan
    Li, Haozhuang
    Ning, Hui
    Zhao, Qingchao
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 85 - 99
  • [6] An Ensemble Net of Convolutional Auto-Encoder and Graph Auto-Encoder for Auto-Diagnosis
    Li, Jianqiang
    Ji, Changping
    Yan, Guokai
    You, Linlin
    Chen, Jie
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2021, 13 (01) : 189 - 199
  • [7] Rethinking Graph Auto-Encoder Models for Attributed Graph Clustering
    Mrabah, Nairouz
    Bouguessa, Mohamed
    Touati, Mohamed Fawzi
    Ksantini, Riadh
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 9037 - 9053
  • [8] Compressing Knowledge Graph Embedding with Relational Graph Auto-encoder
    Zhang, Shiyu
    Zhang, Zhao
    Zhuang, Fuzhen
    Shi, Zhiping
    Han, Xu
    PROCEEDINGS OF 2020 IEEE 10TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2020), 2020, : 366 - 370
  • [9] A Graph Auto-encoder Model of Derivational Morphology
    Hofmann, Valentin
    Schutze, Hinrich
    Pierrehumbert, Janet B.
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 1127 - 1138
  • [10] Fair Graph Auto-Encoder for Unbiased Graph Representations with Wasserstein Distance
    Fan, Wei
    Liu, Kunpeng
    Xie, Rui
    Liu, Hao
    Xiong, Hui
    Fu, Yanjie
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 1054 - 1059