Reinforcement Graph Clustering with Unknown Cluster Number

被引:9
作者
Liu, Yue [1 ]
Liang, Ke [1 ]
Xia, Jun [2 ]
Yang, Xihong [1 ]
Zhou, Sihang [1 ]
Liu, Meng [1 ]
Liu, Xinwang [1 ]
Li, Stan Z. [2 ]
机构
[1] NUDT, Changsha, Hunan, Peoples R China
[2] Westlake Univ, Hangzhou, Zhejiang, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Attribute Graph Clustering; Unknown Cluster Number; Reinforcement Learning; Graph Neural Network;
D O I
10.1145/3581783.3612155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep graph clustering, which aims to group nodes into disjoint clusters by neural networks in an unsupervised manner, has attracted great attention in recent years. Although the performance has been largely improved, the excellent performance of the existing methods heavily relies on an accurately predefined cluster number, which is not always available in the real-world scenario. To enable the deep graph clustering algorithms to work without the guidance of the predefined cluster number, we propose a new deep graph clustering method termed Reinforcement Graph Clustering (RGC). In our proposed method, cluster number determination and unsupervised representation learning are unified into a uniform framework by the reinforcement learning mechanism. Concretely, the discriminative node representations are first learned with the contrastive pretext task. Then, to capture the clustering state accurately with both local and global information in the graph, both node and cluster states are considered. Subsequently, at each state, the qualities of different cluster numbers are evaluated by the quality network, and the greedy action is executed to determine the cluster number. In order to conduct feedback actions, the clustering-oriented reward function is proposed to enhance the cohesion of the same clusters and separate the different clusters. Extensive experiments demonstrate the effectiveness and efficiency of our proposed method. The source code of RGC is shared at https://github.com/yueliu1999/RGC and a collection (papers, codes and, datasets) of deep graph clustering is shared at https://github.com/yueliu1999/Awesome-Deep-Graph-Clustering on Github.
引用
收藏
页码:3528 / 3537
页数:10
相关论文
共 50 条
[31]   Reinforcement Learning Control for a Robotic Manipulator with Unknown Deadzone [J].
Li, Yanan ;
Xiao, Shengtao ;
Ge, Shuzhi Sam .
2014 11TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2014, :593-598
[32]   Bayesian reinforcement learning for navigation planning in unknown environments [J].
Alali, Mohammad ;
Imani, Mahdi .
FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 7
[33]   A reinforcement learning approach for robot control in an unknown environment [J].
Xiao, NF ;
Nahavandi, S .
IEEE ICIT' 02: 2002 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS I AND II, PROCEEDINGS, 2002, :1096-1099
[34]   Hierarchical Reinforcement Learning with Clustering Abstract Machines [J].
Alexey, Skrynnik ;
Panov, Aleksandr, I .
ARTIFICIAL INTELLIGENCE: (RCAI 2019), 2019, 1093 :30-43
[35]   Reinforcement Knowledge Graph Reasoning for Explainable Recommendation [J].
Xian, Yikun ;
Fu, Zuohui ;
Muthukrishnan, S. ;
de Melo, Gerard ;
Zhang, Yongfeng .
PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, :285-294
[36]   Soft dimensionality reduction for reinforcement data clustering [J].
Fatemeh Fathinezhad ;
Peyman Adibi ;
Bijan Shoushtarian ;
Hamidreza Baradaran Kashani ;
Jocelyn Chanussot .
World Wide Web, 2023, 26 :3027-3054
[37]   GRAPH SIGNAL SAMPLING VIA REINFORCEMENT LEARNING [J].
Abramenko, Oleksii ;
Jung, Alexander .
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, :3077-3081
[38]   Causal Reinforcement Learning for Knowledge Graph Reasoning [J].
Li, Dezhi ;
Lu, Yunjun ;
Wu, Jianping ;
Zhou, Wenlu ;
Zeng, Guangjun .
APPLIED SCIENCES-BASEL, 2024, 14 (06)
[39]   Survey of Knowledge Graph Based on Reinforcement Learning [J].
Ma A. ;
Yu Y. ;
Yang S. ;
Shi C. ;
Li J. ;
Cai X. .
Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2022, 59 (08) :1694-1722
[40]   Soft dimensionality reduction for reinforcement data clustering [J].
Fathinezhad, Fatemeh ;
Adibi, Peyman ;
Shoushtarian, Bijan ;
Baradaran Kashani, Hamidreza ;
Chanussot, Jocelyn .
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05) :3027-3054