Level-synchronous BFS algorithm implemented in Java']Java using PCJ Library

被引:0
|
作者
Ryczkowska, Magdalena [1 ]
Nowicki, Marek [1 ]
Bala, Piotr [2 ]
机构
[1] Nicolaus Copernicus Univ, Fac Math & Comp Sci, Chopina 12-18, PL-87100 Torun, Poland
[2] Univ Warsaw, Interdisciplinary Ctr Math & Computat Modeling, Pawinskiego 5a, PL-02106 Warsaw, Poland
来源
2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE & COMPUTATIONAL INTELLIGENCE (CSCI) | 2016年
关键词
parallel and distributed graph algorithms; BFS; !text type='Java']Java[!/text; PGAS; performance evaluation;
D O I
10.1109/CSCI.2016.117
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph processing is used in many fields of science such as sociology, risk prediction or biology. Although analysis of graphs is important it also poses numerous challenges especially for large graphs which have to be processed on multicore systems. In this paper, we present PGAS (Partitioned Global Address Space) version of the level-synchronous BFS (Breadth First Search) algorithm and its implementation written in Java. Java so far is not extensively used in high performance computing, but because of its popularity, portability, and increasing capabilities is becoming more widely exploit especially for data analysis. The level-synchronous BFS has been implemented using a PCJ (Parallel Computations in Java) library. In this paper, we present implementation details and compare its scalability and performance with the MPI implementation of Graph500 benchmark. We show good scalability and performance of our implementation in comparison with MPI code written in C. We present challenges we faced and optimizations we used in our implementation necessary to obtain good performance.
引用
收藏
页码:596 / 601
页数:6
相关论文
共 50 条
  • [1] Parallel Differential Evolution in the PGAS Programming Model Implemented with PCJ Java']Java Library
    Gorski, Lukasz
    Rakowski, Franciszek
    Bala, Piotr
    PARALLEL PROCESSING AND APPLIED MATHEMATICS, PPAM 2015, PT I, 2016, 9573 : 448 - 458
  • [2] Fault-Tolerance Mechanisms for the Java']Java Parallel Codes Implemented with the PCJ Library
    Szynkiewicz, Michal
    Nowicki, Marek
    PARALLEL PROCESSING AND APPLIED MATHEMATICS (PPAM 2017), PT II, 2018, 10778 : 298 - 307
  • [3] PCJ - Java']Java library for high performance computing in PGAS model
    Nowicki, Marekno
    Gorski, Lukasz
    Grabrczyk, Patryk
    Bala, Piotr
    2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2014, : 202 - 209
  • [4] Big Data Analytics in Java']Java with PCJ Library: Performance Comparison with Hadoop
    Nowicki, Marek
    Ryczkowska, Magdalena
    Gorski, Lukasz
    Bala, Piotr
    PARALLEL PROCESSING AND APPLIED MATHEMATICS (PPAM 2017), PT II, 2018, 10778 : 318 - 327
  • [5] PCJ - Java']Java Library for Highly Scalable HPC and Big Data Processing
    Nowicki, Marek
    Gorski, Lukasz
    Bala, Piotr
    PROCEEDINGS 2018 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2018, : 12 - 20
  • [6] PCJ Java']Java library as a solution to integrate HPC, Big Data and Artificial Intelligence workloads
    Nowicki, Marek
    Gorski, Lukasz
    Bala, Piotr
    JOURNAL OF BIG DATA, 2021, 8 (01)
  • [7] Scalable computing in Java with PCJ Library. Improved collective operations
    Nowicki, Marek
    Górski, Lukasz
    Bala, Piotr
    Proceedings of Science, 2021, 378
  • [8] AES algorithm implemented for PDA secure communication with Java']Java
    Liu Niansheng
    Guo Donghui
    Huang Jiaxiang
    2007 INTERNATIONAL WORKSHOP ON ANTI-COUNTERFEITING, SECURITY, AND IDENTIFICATION, 2007, : 217 - +
  • [9] A low-level communication library for Java']Java HPC
    Lim, SB
    Carpenter, B
    Fox, G
    Lee, HK
    DISTRIBUTED AND PARALLEL COMPUTING, 2005, 3719 : 429 - 434
  • [10] Reuse of Java']Java library components using wrappers
    Haddad, Hisham M.
    Mai, Huey
    WMSCI 2005: 9th World Multi-Conference on Systemics, Cybernetics and Informatics, Vol 6, 2005, : 344 - 349