Streaming Algorithms for k-core Decomposition

被引:112
|
作者
Sariyuece, Ahmet Erdem [1 ,2 ]
Gedik, Bugra [3 ]
Jacques-Silva, Gabriela [5 ]
Wu, Kun-Lung [5 ]
Catalyuerek, Uemit V. [1 ,4 ]
机构
[1] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[2] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA
[3] Ihsan Dogramaci Bilkent Univ, Dept Comp Engn, Ankara, Turkey
[4] Ohio State Univ, Dept Elect & Comp Engn, Columbus, OH 43210 USA
[5] IBM Thomas J Watson Res Ctr, IBM Res, Yorktown Hts, NY 10598 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2013年 / 6卷 / 06期
关键词
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I
10.14778/2536336.2536344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A k-core of a graph is a maximal connected subgraph in which every vertex is connected to at least k vertices in the subgraph. k-core decomposition is often used in large-scale network analysis, such as community detection, protein function prediction, visualization, and solving NP-Hard problems on real networks efficiently, like maximal clique finding. In many real-world applications, networks change over time. As a result, it is essential to develop efficient incremental algorithms for streaming graph data. In this paper, we propose the first incremental k-core decomposition algorithms for streaming graph data. These algorithms locate a small subgraph that is guaranteed to contain the list of vertices whose maximum k-core values have to be updated, and efficiently process this subgraph to update the k-core decomposition. Our results show a significant reduction in run-time compared to non-incremental alternatives. We show the efficiency of our algorithms on different types of real and synthetic graphs, at different scales. For a graph of 16 million vertices, we observe speedups reaching a million times, relative to the non-incremental algorithms.
引用
收藏
页码:433 / 444
页数:12
相关论文
共 50 条
  • [1] Parallel and Streaming Algorithms for K-Core Decomposition
    Esfandiari, Hossein
    Lattanzi, Silvio
    Mirrokni, Vahab
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [2] Incremental k-core decomposition: algorithms and evaluation
    Ahmet Erdem Sarıyüce
    Buğra Gedik
    Gabriela Jacques-Silva
    Kun-Lung Wu
    Ümit V. Çatalyürek
    The VLDB Journal, 2016, 25 : 425 - 447
  • [3] Incremental k-core decomposition: algorithms and evaluation
    Sariyuce, Ahmet Erdem
    Gedik, Bugra
    Jacques-Silva, Gabriela
    Wu, Kun-Lung
    Catalyurek, Umit V.
    VLDB JOURNAL, 2016, 25 (03): : 425 - 447
  • [4] Distributed k-Core Decomposition
    Montresor, Alberto
    De Pellegrini, Francesco
    Miorandi, Daniele
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2013, 24 (02) : 288 - 300
  • [5] k-core Decomposition on Giraph and GraphChi
    Hu, Xin
    Liu, Fangming
    Srinivasan, Venkatesh
    Thomo, Alex
    ADVANCES IN INTELLIGENT NETWORKING AND COLLABORATIVE SYSTEMS, INCOS-2017, 2018, 8 : 274 - 284
  • [6] Parallel k-core Decomposition on Multicore Platforms
    Kabir, Humayun
    Madduri, Kamesh
    2017 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2017, : 1482 - 1491
  • [7] Brief Announcement: Distributed k-Core Decomposition
    Montresor, Alberto
    De Pellegrini, Francesco
    Miorandi, Daniele
    PODC 11: PROCEEDINGS OF THE 2011 ACM SYMPOSIUM PRINCIPLES OF DISTRIBUTED COMPUTING, 2011, : 207 - 208
  • [8] A Distributed k-Core Decomposition Algorithm on Spark
    Mandal, Aritra
    Al Hasan, Mohammad
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 976 - 981
  • [9] Modeling AS relationships based on k-core decomposition
    Guo, Hong
    Lan, Ju-Long
    Wang, Tao
    Liu, Luo-Kun
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2011, 39 (11): : 2627 - 2634
  • [10] Vectorising k-Core Decomposition for GPU Acceleration
    Mehrafsa, Amir
    Chester, Sean
    Thomo, Alex
    PROCEEDINGS OF THE 32TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, SSDBM 2020, 2020,