Anomaly detection and community detection in networks

被引:0
作者
Hadiseh Safdari
Caterina De Bacco
机构
[1] Max Planck Institute for Intelligent Systems,
来源
Journal of Big Data | / 9卷
关键词
Probabilistic models; Latent variable models; Community detection; Anomaly detection;
D O I
暂无
中图分类号
学科分类号
摘要
Anomaly detection is a relevant problem in the area of data analysis. In networked systems, where individual entities interact in pairs, anomalies are observed when pattern of interactions deviates from patterns considered regular. Properly defining what regular patterns entail relies on developing expressive models for describing the observed interactions. It is crucial to address anomaly detection in networks. Among the many well-known models for networks, latent variable models—a class of probabilistic models—offer promising tools to capture the intrinsic features of the data. In this work, we propose a probabilistic generative approach that incorporates domain knowledge, i.e., community membership, as a fundamental model for regular behavior, and thus flags potential anomalies deviating from this pattern. In fact, community membership serves as the building block of a null model to identify the regular interaction patterns. The structural information is included in the model through latent variables for community membership and anomaly parameter. The algorithm aims at inferring these latent parameters and then output the labels identifying anomalies on the network edges.
引用
收藏
相关论文
共 54 条
[1]  
Hodge VJ(2004)A survey of outlier detection methodologies Artif Intell Rev 22 85-126
[2]  
Austin J(2005)Detection of outliers in reference distributions: performance of horn’s algorithm Clin Chem 51 2326-32
[3]  
Solberg HE(2012)An autonomous labeling approach to support vector machines algorithms for network traffic anomaly detection Expert Syst Appl 39 1822-1829
[4]  
Lahti A(2017)Deep ip flow inspection to detect beyond network anomalies Comput Commun 98 80-96
[5]  
Catania CA(2021)Deep learning for anomaly detection: a review ACM Comput Surv 41 1-58
[6]  
Bromberg F(2009)Anomaly detection: a survey ACM Comput Surv 99 7821-6
[7]  
Garino CG(2002)Community structure in social and biological networks Proc Nat Acad Sci 486 75-174
[8]  
Amaral AA(2010)Community detection in graphs Phys Rep 3 243-257
[9]  
de Souza Mendes L(2018)A survey on online social network anomaly detection Int J Innov Sci Res Technol 39 62-70
[10]  
Zarpelão BB(2014)Anomaly detection in online social networks Soc Netw 95 129-233