A Low Communication Overhead Breadth-First Search Based on Global Bitmap

被引:1
|
作者
Peng, Ziwei [1 ,2 ]
Lu, Yutong [1 ,2 ,3 ]
Cheng, Zhiguang [1 ,2 ,3 ]
Du, Yunfei [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] Natl Supercomp Ctr Guangzhou, Guangzhou 510006, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Peoples R China
来源
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT II | 2018年 / 11335卷
基金
国家重点研发计划;
关键词
Graph500; Breadth-First Search; Global bitmap; Hybrid approach;
D O I
10.1007/978-3-030-05054-2_9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Breadth-First Search (BFS) is the underlying kernel algorithm for many graph applications such as social networks, medical informatics, transport systems, etc. Therefore, it has been absorbed as a core of Graph500, used to evaluate the capability of supercomputers in terms of big data processing. In this paper, we introduce into a global bitmap which is used to accelerate two approaches: the top-down and bottom-up. Specifically, the new top-down approach uses the global bitmap to indicate whether the vertices are visited or not, while the new bottom-up approach changes the frontier queue to the global bitmap to indicate whether the vertices are on the frontier. With the help of the global bitmap, the total number of communication messages produced by the BFS will be reduced significantly, and consequentially the BFS is accelerated. Meanwhile, our algorithm is optimized for storage on Knights Landing (KNL). We evaluate our proposal on both the KNL platform and the Tianhe-2 supercomputer. Experimental results demonstrate that the communication was time reduced to roughly 1/4 of the original. We obtain speedups of 2.2-3.1 compared to the top-down approach.
引用
收藏
页码:114 / 129
页数:16
相关论文
共 50 条
  • [21] Maximum Flows by Incremental Breadth-First Search
    Goldberg, Andrew V.
    Hed, Sagi
    Kaplan, Haim
    Tarjan, Robert E.
    Werneck, Renato F.
    ALGORITHMS - ESA 2011, 2011, 6942 : 457 - 468
  • [22] An Effective GPU Implementation of Breadth-First Search
    Luo, Lijuan
    Wong, Martin
    Hwu, Wen-mei
    PROCEEDINGS OF THE 47TH DESIGN AUTOMATION CONFERENCE, 2010, : 52 - 55
  • [23] Efficient breadth-first search on the Cell/BE processor
    Scarpazza, Daniele Paolo
    Villa, Oreste
    Petrini, Fabrizio
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2008, 19 (10) : 1381 - 1395
  • [24] Extreme Scale Breadth-First Search on Supercomputers
    Ueno, Koji
    Suzumura, Toyotaro
    Maruyama, Naova
    Fujisawa, Katsuki
    Matsuoka, Satoshi
    2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, : 1040 - 1047
  • [25] Improving vertex-frontier based GPU breadth-first search
    杨博
    卢凯
    高颖慧
    徐凯
    王小平
    程志权
    Journal of Central South University, 2014, 21 (10) : 3828 - 3836
  • [26] Task-based Parallel Breadth-First Search in Heterogeneous Environments
    Munguia, Lluis-Miquel
    Bader, David A.
    Ayguade, Eduard
    2012 19TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2012,
  • [27] A breadth-first search based service restoration algorithm for distribution network
    Zhang, Hai-Bo
    Zhang, Xiao-Yun
    Tao, Wen-Wei
    Dianwang Jishu/Power System Technology, 2010, 34 (07): : 103 - 108
  • [28] Improving vertex-frontier based GPU breadth-first search
    Yang Bo
    Lu Kai
    Gao Ying-hui
    Xu Kai
    Wang Xiao-ping
    Cheng Zhi-quan
    JOURNAL OF CENTRAL SOUTH UNIVERSITY, 2014, 21 (10) : 3828 - 3836
  • [29] An adaptive breadth-first search algorithm on integrated architectures
    Zhang, Feng
    Lin, Heng
    Zhai, Jidong
    Cheng, Jie
    Xiang, Dingyi
    Li, Jizhong
    Chai, Yunpeng
    Du, Xiaoyong
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (11): : 6135 - 6155
  • [30] Improving vertex-frontier based GPU breadth-first search
    Bo Yang
    Kai Lu
    Ying-hui Gao
    Kai Xu
    Xiao-ping Wang
    Zhi-quan Cheng
    Journal of Central South University, 2014, 21 : 3828 - 3836