Clustering large attributed information networks: an efficient incremental computing approach

被引:36
作者
Cheng, Hong [1 ]
Zhou, Yang [2 ]
Huang, Xin [1 ]
Yu, Jeffrey Xu [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Syst Engn & Engn Management, Hong Kong, Hong Kong, Peoples R China
[2] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA
关键词
Graph clustering; Incremental computation; Parallel computing; RANDOM-WALK; RESTART;
D O I
10.1007/s10618-012-0263-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many information networks have become available for analysis, including social networks, road networks, sensor networks, biological networks, etc. Graph clustering has shown its effectiveness in analyzing and visualizing large networks. The goal of graph clustering is to partition vertices in a large graph into clusters based on various criteria such as vertex connectivity or neighborhood similarity. Many existing graph clustering methods mainly focus on the topological structures, but largely ignore the vertex properties which are often heterogeneous. Recently, a new graph clustering algorithm, SA-cluster, has been proposed which combines structural and attribute similarities through a unified distance measure. SA-Cluster performs matrix multiplication to calculate the random walk distances between graph vertices. As part of the clustering refinement, the graph edge weights are iteratively adjusted to balance the relative importance between structural and attribute similarities. As a consequence, matrix multiplication is repeated in each iteration of the clustering process to recalculate the random walk distances which are affected by the edge weight update. In order to improve the efficiency and scalability of SA-cluster, in this paper, we propose an efficient algorithm In-Cluster to incrementally update the random walk distances given the edge weight increments. Complexity analysis is provided to estimate how much runtime cost Inc-Cluster can save. We further design parallel matrix computation techniques on a multicore architecture. Experimental results demonstrate that Inc-Cluster achieves significant speedup over SA-Cluster on large graphs, while achieving exactly the same clustering quality in terms of intra-cluster structural cohesiveness and attribute value homogeneity.
引用
收藏
页码:450 / 477
页数:28
相关论文
共 23 条
  • [1] [Anonymous], 2002, P 8 ACM SIGKDD INT C
  • [2] Finding and evaluating community structure in networks
    Newman, MEJ
    Girvan, M
    [J]. PHYSICAL REVIEW E, 2004, 69 (02) : 026113 - 1
  • [3] [Anonymous], JOURNAL OF GRAPH ALG
  • [4] [Anonymous], 2008, P ACM INT C MAN DAT, DOI DOI 10.1145/1376616.1376661
  • [5] [Anonymous], 2006, P 23 INT C MACHINE L, DOI DOI 10.1145/1143844.1143918
  • [6] [Anonymous], S FDN COMP SCI FOCS
  • [7] [Anonymous], 2009, RANKCLUS INTEGRATING, DOI DOI 10.1145/1516360.1516426
  • [8] Cai D., 2005, International Workshop on Link Discovery, P58, DOI DOI 10.1145/1134271.1134280
  • [9] Desikan Prasanna., 2005, Special interest tracks and 114 posters of the 14th international conference on World Wide Web, P1094, DOI DOI 10.1145/1062745.1062885
  • [10] Probabilistic latent semantic indexing
    Hofmann, T
    [J]. SIGIR'99: PROCEEDINGS OF 22ND INTERNATIONAL CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 1999, : 50 - 57