Generating Massive Scale-free Networks: Novel Parallel Algorithms using the Preferential Attachment Model

被引:2
作者
Alam, Maksudul [1 ]
Khan, Maleq [2 ]
Perumalla, Kalyan S. [1 ]
Marathe, Madhav [3 ,4 ]
机构
[1] Oak Ridge Natl Lab, 1 Bethel Valley Rd, Oak Ridge, TN 37831 USA
[2] Texas A&M Univ Kingsville, 700 Univ Blvd, Kingsville, TX 78363 USA
[3] Univ Virginia, Network Syst Sci & Adv Comp Div, Biocomplex Inst & Initiat, Res Pk Blvd, Charlottesville, VA 22904 USA
[4] Univ Virginia, Dept Comp Sci, Res Pk Blvd, Charlottesville, VA 22904 USA
关键词
Network science; random networks; preferential attachment; distributed algorithms; POWER LAWS; TOLERANCE;
D O I
10.1145/3391446
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, there has been substantial interest in the study of various random networks as mathematical models of complex systems. As real-life complex systems grow larger, the ability to generate progressively large random networks becomes all the more important. This motivates the need for efficient parallel algorithms for generating such networks. Naive parallelization of sequential algorithms for generating random networks is inefficient due to inherent dependencies among the edges and the possibility of creating duplicate (parallel) edges. In this article, we present message passing interface-based distributed memory parallel algorithms for generating random scale-free networks using the preferential-attachment model. Our algorithms are experimentally verified to scale very well to a large number of processing elements (PEs), providing near-linear speedups. The algorithms have been exercised with regard to scale and speed to generate scale-free networks with one trillion edges in 6 minutes using 1,000 PEs.
引用
收藏
页数:35
相关论文
共 47 条
[1]  
Alam M.F., 2016, Student thesis
[2]   Novel Parallel Algorithms for Fast Multi-GPU-Based Generation of Massive Scale-Free Networks [J].
Alam, Maksudul ;
Perumalla, Kalyan S. ;
Sanders, Peter .
DATA SCIENCE AND ENGINEERING, 2019, 4 (01) :61-75
[3]  
Alam M, 2016, SC '16: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, P372
[4]  
Alam M, 2017, IEEE INT CONF BIG DA, P3302, DOI 10.1109/BigData.2017.8258315
[5]   Distributed-Memory Parallel Algorithms for Generating Massive Scale-free Networks Using Preferential Attachment Model [J].
Alam, Maksudul ;
Khan, Maleq ;
Marathe, Madhav V. .
2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), 2013,
[6]   Error and attack tolerance of complex networks [J].
Albert, R ;
Jeong, H ;
Barabási, AL .
NATURE, 2000, 406 (6794) :378-382
[7]  
Aliakbary, 2016, P 31 ANN ACM S APPL, DOI [10.1145/2851613.2851722, DOI 10.1145/2851613.2851722]
[8]  
[Anonymous], 2008, P 17 INT C WORLD WID, DOI [DOI 10.1145/1367497.1367620, 10.1145/1367497.1367620]
[9]   Parallel algorithms for evaluating centrality indices in real-world networks [J].
Bader, David A. ;
Madduri, Kamesh .
2006 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, PROCEEDINGS, 2006, :539-547
[10]   Network biology:: Understanding the cell's functional organization [J].
Barabási, AL ;
Oltvai, ZN .
NATURE REVIEWS GENETICS, 2004, 5 (02) :101-U15