A Low Communication Overhead Breadth-First Search Based on Global Bitmap

被引:1
作者
Peng, Ziwei [1 ,2 ]
Lu, Yutong [1 ,2 ,3 ]
Cheng, Zhiguang [1 ,2 ,3 ]
Du, Yunfei [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] Natl Supercomp Ctr Guangzhou, Guangzhou 510006, Peoples R China
[3] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Peoples R China
来源
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2018, PT II | 2018年 / 11335卷
基金
国家重点研发计划;
关键词
Graph500; Breadth-First Search; Global bitmap; Hybrid approach;
D O I
10.1007/978-3-030-05054-2_9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Breadth-First Search (BFS) is the underlying kernel algorithm for many graph applications such as social networks, medical informatics, transport systems, etc. Therefore, it has been absorbed as a core of Graph500, used to evaluate the capability of supercomputers in terms of big data processing. In this paper, we introduce into a global bitmap which is used to accelerate two approaches: the top-down and bottom-up. Specifically, the new top-down approach uses the global bitmap to indicate whether the vertices are visited or not, while the new bottom-up approach changes the frontier queue to the global bitmap to indicate whether the vertices are on the frontier. With the help of the global bitmap, the total number of communication messages produced by the BFS will be reduced significantly, and consequentially the BFS is accelerated. Meanwhile, our algorithm is optimized for storage on Knights Landing (KNL). We evaluate our proposal on both the KNL platform and the Tianhe-2 supercomputer. Experimental results demonstrate that the communication was time reduced to roughly 1/4 of the original. We obtain speedups of 2.2-3.1 compared to the top-down approach.
引用
收藏
页码:114 / 129
页数:16
相关论文
共 50 条
  • [1] Efficient Breadth-First Reduct Search
    Boonjing, Veera
    Chanvarasuth, Pisit
    MATHEMATICS, 2020, 8 (05)
  • [2] Direction-optimizing breadth-first search
    Beamer, Scott
    Asanovic, Krste
    Patterson, David
    SCIENTIFIC PROGRAMMING, 2013, 21 (3-4) : 137 - 148
  • [3] Virtual network embedding algorithm based on breadth-first search
    Peng, Limin
    Sichuan Daxue Xuebao (Gongcheng Kexue Ban)/Journal of Sichuan University (Engineering Science Edition), 2015, 47 (02): : 117 - 122
  • [4] Parallelizability of the stack breadth-first search problem
    Nakashima, T
    Fujiwara, A
    PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 722 - 727
  • [5] A parallel algorithm for the stack breadth-first search
    Nakashima, T
    Fujiwara, A
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2002, E85D (12) : 1955 - 1958
  • [6] Efficient distributed breadth-first search algorithm
    Makki, SAM
    COMPUTER COMMUNICATIONS, 1996, 19 (08) : 628 - 636
  • [7] Extreme Scale Breadth-First Search on Supercomputers
    Ueno, Koji
    Suzumura, Toyotaro
    Maruyama, Naova
    Fujisawa, Katsuki
    Matsuoka, Satoshi
    2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, : 1040 - 1047
  • [8] Improving vertex-frontier based GPU breadth-first search
    杨博
    卢凯
    高颖慧
    徐凯
    王小平
    程志权
    Journal of Central South University, 2014, 21 (10) : 3828 - 3836
  • [9] Improving vertex-frontier based GPU breadth-first search
    Yang Bo
    Lu Kai
    Gao Ying-hui
    Xu Kai
    Wang Xiao-ping
    Cheng Zhi-quan
    JOURNAL OF CENTRAL SOUTH UNIVERSITY, 2014, 21 (10) : 3828 - 3836
  • [10] An adaptive breadth-first search algorithm on integrated architectures
    Zhang, Feng
    Lin, Heng
    Zhai, Jidong
    Cheng, Jie
    Xiang, Dingyi
    Li, Jizhong
    Chai, Yunpeng
    Du, Xiaoyong
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (11) : 6135 - 6155