Reinforcement Graph Clustering with Unknown Cluster Number

被引:7
作者
Liu, Yue [1 ]
Liang, Ke [1 ]
Xia, Jun [2 ]
Yang, Xihong [1 ]
Zhou, Sihang [1 ]
Liu, Meng [1 ]
Liu, Xinwang [1 ]
Li, Stan Z. [2 ]
机构
[1] NUDT, Changsha, Hunan, Peoples R China
[2] Westlake Univ, Hangzhou, Zhejiang, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Attribute Graph Clustering; Unknown Cluster Number; Reinforcement Learning; Graph Neural Network;
D O I
10.1145/3581783.3612155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep graph clustering, which aims to group nodes into disjoint clusters by neural networks in an unsupervised manner, has attracted great attention in recent years. Although the performance has been largely improved, the excellent performance of the existing methods heavily relies on an accurately predefined cluster number, which is not always available in the real-world scenario. To enable the deep graph clustering algorithms to work without the guidance of the predefined cluster number, we propose a new deep graph clustering method termed Reinforcement Graph Clustering (RGC). In our proposed method, cluster number determination and unsupervised representation learning are unified into a uniform framework by the reinforcement learning mechanism. Concretely, the discriminative node representations are first learned with the contrastive pretext task. Then, to capture the clustering state accurately with both local and global information in the graph, both node and cluster states are considered. Subsequently, at each state, the qualities of different cluster numbers are evaluated by the quality network, and the greedy action is executed to determine the cluster number. In order to conduct feedback actions, the clustering-oriented reward function is proposed to enhance the cohesion of the same clusters and separate the different clusters. Extensive experiments demonstrate the effectiveness and efficiency of our proposed method. The source code of RGC is shared at https://github.com/yueliu1999/RGC and a collection (papers, codes and, datasets) of deep graph clustering is shared at https://github.com/yueliu1999/Awesome-Deep-Graph-Clustering on Github.
引用
收藏
页码:3528 / 3537
页数:10
相关论文
共 50 条
  • [21] Water Quality Prediction Method Based on Reinforcement Learning Graph Neural Network
    Yan, Mingming
    Wang, Zhe
    IEEE ACCESS, 2024, 12 : 184421 - 184430
  • [22] Adversarial Reinforcement Learning With Object-Scene Relational Graph for Video Captioning
    Hua, Xia
    Wang, Xinqing
    Rui, Ting
    Shao, Faming
    Wang, Dong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2004 - 2016
  • [23] Transferable traffic signal control: Reinforcement learning with graph centric state representation
    Yoon, Jinwon
    Ahn, Kyuree
    Park, Jinkyoo
    Yeo, Hwasoo
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 130
  • [24] A Combat Decision Support Method Based on OODA and Dynamic Graph Reinforcement Learning
    Xu, Bin
    Zeng, Wei
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 4872 - 4878
  • [25] On Adaptive Edge Microservice Placement: A Reinforcement Learning Approach Endowed With Graph Comprehension
    Chen, Lixing
    Bai, Yang
    Zhou, Pan
    Li, Youqi
    Qu, Zhe
    Xu, Jie
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 11144 - 11158
  • [26] Deep Relationship Graph Reinforcement Learning for Multi-Aircraft Air Combat
    Han, Yue
    Piao, Haiyin
    Hou, Yaqing
    Sun, Yang
    Sun, Zhixiao
    Zhou, Deyun
    Yang, Shengqi
    Peng, Xuanqi
    Fan, Songyuan
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [27] An intelligent Hybrid-Q Learning clustering approach and resource management within heterogeneous cluster networks based on reinforcement learning
    Mughal, Fahad Razaque
    He, Jingsha
    Zhu, Nafei
    Almutiq, Mutiq
    Dharejo, Fayaz Ali
    Jain, Deepak Kumar
    Hussain, Saqib
    Zardari, Zulfiqar Ali
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (04)
  • [28] Bayesian reinforcement learning for navigation planning in unknown environments
    Alali, Mohammad
    Imani, Mahdi
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 7
  • [29] Reinforcement Learning Control for a Robotic Manipulator with Unknown Deadzone
    Li, Yanan
    Xiao, Shengtao
    Ge, Shuzhi Sam
    2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, : 593 - 598
  • [30] A reinforcement learning approach for robot control in an unknown environment
    Xiao, NF
    Nahavandi, S
    IEEE ICIT' 02: 2002 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS I AND II, PROCEEDINGS, 2002, : 1096 - 1099