MapReduce for Graphs Processing: New Big Data Algorithm for 2-Edge Connected Components and Future Ideas

被引:3
作者
Dahiphale, Devendra [1 ]
机构
[1] Univ Maryland, Dept Comp Sci & Elect Engn, Baltimore, MD 21250 USA
关键词
Graph; distributed; algorithm; connected component; big data; MapReduce; undirected; small star; large star; analysis; serial algorithms; parallel; cascaded jobs; Hadoop; streaming; connectivity; CLOUD MAPREDUCE;
D O I
10.1109/ACCESS.2023.3281266
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Finding connectivity in graphs has numerous applications, such as social network analysis, data mining, intra-city or inter-cities connectivity, neural network, and many more. The deluge of graph applications makes graph connectivity problems extremely important and worthwhile to explore. Currently, there are many single-node algorithms for graph mining and analysis; however, those algorithms primarily apply to small graphs and are implemented on a single machine node. Finding 2-edge connected components (2-ECCs) in massive graphs (billions of edges and vertices) is impractical and time-consuming, even with the best-known single-node algorithms. Processing a big graph in a parallel and distributed fashion saves considerable time to finish processing. Moreover, it enables stream data processing by allowing quick results for vast and continuous nature data sets. This research proposes a distributed and parallel algorithm for finding 2-ECCs in big undirected graphs (subsequently called ``BiECCA'') and presents its time complexity analysis. The proposed algorithm is implemented on a MapReduce framework and uses an existing algorithm to find connected components (CCs) in a graph as a sub-step. Finally, we suggest a few novel ideas and approaches as extensions to our work.
引用
收藏
页码:54986 / 55001
页数:16
相关论文
共 42 条
[1]   Power-Law Distributed Graph Generation With MapReduce [J].
Angles, Renzo ;
Lopez-Gallegos, Fernanda ;
Paredes, Rodrigo .
IEEE ACCESS, 2021, 9 :94405-94415
[2]   R3MAT: A Rapid and Robust Graph Generator [J].
Angles, Renzo ;
Paredes, Rodrigo ;
Garcia, Roberto .
IEEE ACCESS, 2020, 8 :130048-130065
[3]  
[Anonymous], 2014, P ACM S CLOUD COMP N
[4]  
[Anonymous], 1971, 12 ANN S SWITCH AUT, DOI DOI 10.1109/SWAT.1971.10
[5]   Graph Computing Systems and Partitioning Techniques: A Survey [J].
Ayall, Tewodros Alemu ;
Liu, Huawen ;
Zhou, Changjun ;
Seid, Abegaz Mohammed ;
Gereme, Fantahun Bogale ;
Abishu, Hayla Nahom ;
Yacob, Yasin Habtamu .
IEEE ACCESS, 2022, 10 :118523-118550
[6]   APPLICATIONS OF NUMBERED UNDIRECTED GRAPHS [J].
BLOOM, GS ;
GOLOMB, SW .
PROCEEDINGS OF THE IEEE, 1977, 65 (04) :562-570
[7]  
Bondy J. A., 1976, Graph theory with applications
[8]  
Condie T., 2010, NSDI, P313
[9]  
Dahiphale D., 2017, ALGORITHM FINDING 2
[10]   An Advanced MapReduce: Cloud MapReduce, Enhancements and Applications [J].
Dahiphale, Devendra ;
Karve, Rutvik ;
Vasilakos, Athanasios V. ;
Liu, Huan ;
Yu, Zhiwei ;
Chhajer, Amit ;
Wang, Jianmin ;
Wang, Chaokun .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2014, 11 (01) :101-115