A multi-level anomaly detection algorithm for time-varying graph data with interactive visualization

被引:6
作者
Bridges, Robert A. [1 ]
Collins, John [1 ]
Ferragut, Erik M. [1 ]
Laska, Jason [1 ]
Sullivan, Blair D. [2 ]
机构
[1] Oak Ridge Natl Lab, Computat Sci & Engn Div, Oak Ridge, TN 32831 USA
[2] North Carolina State Univ, Dept Comp Sci, Raleigh, NC 27695 USA
关键词
Anomaly detection; Graph sequence; Visualization;
D O I
10.1007/s13278-016-0409-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work presents a modeling and analysis framework for graph sequences which addresses the challenge of detecting and contextualizing anomalies in streaming graph data. Our goal is to detect changes at multiple levels of granularity, thereby identifying specific nodes and subgraphs causing a graph to appear anomalously. In particular, the framework detects changes in community membership, density, and node degree in a sequence of graphs where these are relatively stable. In route to this end, we introduce a new graph model, a generalization of the BTER model of Seshadhri et al., by adding flexibility to community structure, and use this model to perform multi-scale graph anomaly detection. This technique provides insight into a graph's structure and internal context that may shed light on a detected event. Additionally, this multi-scale analysis facilitates intuitive visualizations by allowing users to narrow focus from an anomalous graph to particular subgraphs or nodes causing the anomaly. For evaluation, two hierarchical anomaly detectors are tested against a baseline Gaussian method on a series of sampled graphs. We demonstrate that our graph statistics-based approach outperforms both a distribution-based detector and the baseline in a labeled setting with community structure, and it accurately detects anomalies in synthetic and real-world datasets at the node, subgraph, and graph levels. To illustrate the accessibility of information made possible via this technique, the anomaly detector and an associated interactive visualization tool are tested on NCAA football data, where teams and conferences that moved within the league are identified with perfect recall, and precision >0.786.
引用
收藏
页数:14
相关论文
共 22 条
[1]   Graph based anomaly detection and description: a survey [J].
Akoglu, Leman ;
Tong, Hanghang ;
Koutra, Danai .
DATA MINING AND KNOWLEDGE DISCOVERY, 2015, 29 (03) :626-688
[2]   Emergence of scaling in random networks [J].
Barabási, AL ;
Albert, R .
SCIENCE, 1999, 286 (5439) :509-512
[3]   Multi-Level Anomaly Detection on Time-Varying Graph Data [J].
Bridges, Robert A. ;
Collins, John P. ;
Ferragut, Erik M. ;
Laska, Jason A. ;
Sullivan, Blair D. .
PROCEEDINGS OF THE 2015 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM 2015), 2015, :579-583
[4]   Graph mining: Laws, generators, and algorithms [J].
Chakrabarti, Deepayan ;
Faloutsos, Christos .
ACM COMPUTING SURVEYS, 2006, 38 (01) :A1-A69
[5]   The average distances in random graphs with given expected degrees [J].
Chung, F ;
Lu, LY .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2002, 99 (25) :15879-15882
[6]   Anomaly detection in data represented as graphs [J].
Eberle, William ;
Holder, Lawrence .
INTELLIGENT DATA ANALYSIS, 2007, 11 (06) :663-689
[7]  
Erdos P, 1959, PUBL MATH-DEBRECEN, V6, P290, DOI DOI 10.2307/1999405
[8]   A New, Principled Approach to Anomaly Detection [J].
Ferragut, Erik M. ;
Laska, Jason ;
Bridges, Robert A. .
2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 2, 2012, :210-215
[9]   Community detection in graphs [J].
Fortunato, Santo .
PHYSICS REPORTS-REVIEW SECTION OF PHYSICS LETTERS, 2010, 486 (3-5) :75-174
[10]  
Hagberg A. A., 2008, P 7 PYTH SCI C SCIPY, P11, DOI DOI 10.25080/ISSN.2575-9752