Power-Law Distributed Graph Generation With MapReduce

被引:3
|
作者
Angles, Renzo [1 ,2 ]
Lopez-Gallegos, Fernanda [2 ]
Paredes, Rodrigo [1 ]
机构
[1] Univ Talca, Dept Comp Sci, Fac Engn, Curico 3340000, Chile
[2] Millennium Inst Fdn Res Data, Curico 3340000, Chile
关键词
Generators; Tools; Cluster computing; Computational modeling; Directed graphs; Benchmark testing; Scalability; Graph generator; MapReduce; Hadoop; MODEL;
D O I
10.1109/ACCESS.2021.3093329
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A graph generator is a tool which allows to create graph-like data whose structural properties are very similar to those found in real world networks. This paper presents two methods to generate graphs with power-law edge distribution based on the MapReduce processing model that can be easily implemented to run on top of Apache Hadoop. The proposed methods allow the generation of directed and undirected power-law distributed graphs without repeated edges. Our experimental evaluation shows that our methods are efficient and scalable in terms of both graph size and cluster capacity.
引用
收藏
页码:94405 / 94415
页数:11
相关论文
共 50 条
  • [1] A Distributed Abnormal Packet Generation Engine Based on MapReduce
    Zhang Qi-fei
    Lv Hong-bin
    Pan Xue-zeng
    Wang Chao
    Li Wen-juan
    2012 19TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2012,
  • [2] Distributed Data Management Using MapReduce
    Li, Feng
    Ooi, Beng Chin
    Oezsu, M. Tamer
    Wu, Sai
    ACM COMPUTING SURVEYS, 2014, 46 (03)
  • [3] Distributed subgraph query for RDF graph data based on MapReduce
    Su, Qianxiang
    Huang, Qingrong
    Wu, Nan
    Pan, Ying
    COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
  • [4] Distributed Fixed/Preassigned-Time Optimization Based on Piecewise Power-Law Design
    Ma, Lanlan
    Hu, Cheng
    Yu, Juan
    Wang, Leimin
    Jiang, Haijun
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (07) : 4320 - 4333
  • [5] What is the mechanism of power-law distributed Poincare recurrences in higher-dimensional systems?
    Lange, Steffen
    Baecker, Arnd
    Ketzmerick, Roland
    EPL, 2016, 116 (03)
  • [6] Graph Twiddling in a MapReduce World
    Cohen, Jonathan
    COMPUTING IN SCIENCE & ENGINEERING, 2009, 11 (04) : 29 - 41
  • [7] Power-law distribution of city fires
    Song, WG
    Zhang, HP
    Chen, T
    Fan, WC
    FIRE SAFETY JOURNAL, 2003, 38 (05) : 453 - 465
  • [8] The screen printing of a power-law fluid
    Taroni, M.
    Breward, C. J. W.
    Howell, P. D.
    Oliver, J. M.
    Young, R. J. S.
    JOURNAL OF ENGINEERING MATHEMATICS, 2012, 73 (01) : 93 - 119
  • [9] Distributed RDFS Reasoning with MapReduce
    Cetin, Yigit
    Abul, Osman
    INFORMATION SCIENCES AND SYSTEMS 2014, 2014, : 305 - 313
  • [10] Solutions and conservation laws of Benjamin-Bona-Mahony-Peregrine equation with power-law and dual power-law nonlinearities
    Khalique, Chaudry Masood
    PRAMANA-JOURNAL OF PHYSICS, 2013, 80 (03): : 413 - 427