Scalable multi-node multi-GPU Louvain community detection algorithm for heterogeneous architectures

被引:1
作者
Bhowmick, Anwesha [1 ]
Vadhiyar, Sathish [2 ]
Varun, P. V. [2 ]
机构
[1] WalMart Labs, Bangalore, Karnataka, India
[2] Indian Inst Sci, Dept Computat & Data Sci, Bangalore, Karnataka, India
关键词
community detection; GPUs; Louvain algorithm; SCHEME;
D O I
10.1002/cpe.6987
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Community detection is an important problem that is widely applied for finding cluster patterns in brain, social, biological, and many other kinds of networks. In this work, we have developed a multi-node multi-GPU Louvain community detection algorithm, simultaneously harnessing the CPU and GPU cores of the devices. The algorithm partitions a given graph across multiple nodes and devices in the nodes and performs independent computations of Louvain algorithm on the parts on the devices. The independently formed communities in the devices are refined by identification of doubtful vertices and migrating them to the other processors. The communities are merged using a hierarchical merging algorithm that ensures that at any point the merged component can be accommodated within a processor. Our experiments show that our algorithm is highly scalable with increasing number of devices and provides large-scale performance for BigData graphs.
引用
收藏
页数:18
相关论文
共 30 条
[1]  
[Anonymous], 2006, Gtgraph: A synthetic graph generator suite
[2]   GossipMap: A Distributed Community Detection Algorithm for Billion-Edge Directed Graphs [J].
Bae, Seung-Hee ;
Howe, Bill .
PROCEEDINGS OF SC15: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2015,
[3]   HyDetect: A Hybrid CPU-GPU Algorithm for Community Detection [J].
Bhowmik, Anwesha ;
Vadhiyar, Sathish .
2019 IEEE 26TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, AND ANALYTICS (HIPC), 2019, :2-11
[4]   Fast unfolding of communities in large networks [J].
Blondel, Vincent D. ;
Guillaume, Jean-Loup ;
Lambiotte, Renaud ;
Lefebvre, Etienne .
JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2008,
[5]  
Boldi P., 2004, P 13 INT C WORLD WID, P595
[6]  
Boldi P., 2011, P 20 INT C WORLD WID, P587
[7]  
Cheong C., 2013, EURO PAR PARALLEL PR
[8]   The University of Florida Sparse Matrix Collection [J].
Davis, Timothy A. ;
Hu, Yifan .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2011, 38 (01)
[9]   Adaptive parallel Louvain community detection on a multicore platform [J].
Fazlali, Mahmood ;
Moradi, Ehsan ;
Malazi, Hadi Tabatabaee .
MICROPROCESSORS AND MICROSYSTEMS, 2017, 54 :26-34
[10]   Distributed Louvain Algorithm for Graph Community Detection [J].
Ghosh, Sayan ;
Halappanavar, Mahantesh ;
Tumeo, Antonino ;
Kalyanaraman, Ananth ;
Lu, Hao ;
Chavarria-Miranda, Daniel ;
Khan, Arif ;
Gebremedhin, Assefaw H. .
2018 32ND IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2018, :885-895