A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection

被引:0
作者
Bah, Mohamed Jaward [1 ]
Wang, Hongzhi [1 ]
机构
[1] Harbin Inst Technol, Mass Data Comp Lab, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
关键词
outlier detection; parametric; non-parametric; Gaussian mixture model; kernel density estimate; KERNEL DENSITY-ESTIMATION; CROSS-VALIDATION; NETWORKS;
D O I
10.6688/JISE.202003_36(2).0018
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Outlier detection is an essential problem that has been studied in a wide range of applications in diverse fields. One common approach to outlier detection is using statistical models, but these methods have inherent challenges and drawbacks. For instance, in providing optimal solutions that will enable the idea of detecting outliers more effectively with a high detection rate and in minimizing the computational cost. Many statistical techniques that have been proposed are classified into mainly parametric and non-parametric methods, and to the best of our knowledge, evaluating and deciphering the effects of these methods against each other remains to be an open research direction, and most of these statistical methods proposed earlier have not shown high outlier detection accuracy. In this paper, under the umbrella and generalization of statistical approach, we propose Gaussian Mixture Model for Outlier Detection (GMMOD) for the parametric approach and Kernel Density Estimation for Outlier Detection (KDEOD) algorithms for the non-parametric approach, for solving the problem of detecting outliers more effectively and in improving the outlier detection accuracy. The proposed methods are applied to real-world datasets, and our experimental results show that even though both techniques perform well, KDEOD shows favorable by a smaller margin in most cases when compared to GMMOD and both show improved performance over their similar comparative algorithms.
引用
收藏
页码:441 / 465
页数:25
相关论文
共 41 条
[1]  
[Anonymous], 2015, Int. J. Control. Autom.
[2]  
[Anonymous], TOPICS NONPARAMETRIC
[3]  
[Anonymous], 2014, TOPICS NONPARAMETRIC, DOI DOI 10.1007/978-1-4939-0569-022
[4]  
[Anonymous], EXPECTATION MAXIMIZA
[5]  
[Anonymous], 2011, Journal of Data Science
[6]  
[Anonymous], P IEEE S SEC PRIV WO
[7]  
[Anonymous], P INT C DAT SCI
[8]  
[Anonymous], 2009, P SIAM C DAT MIN SDM
[9]  
[Anonymous], J PROBABILITY STAT
[10]   Outlier detection approaches for wireless sensor networks: A survey [J].
Ayadi, Aya ;
Ghorbel, Oussama ;
Obeid, Abdulfattah M. ;
Abid, Mohamed .
COMPUTER NETWORKS, 2017, 129 :319-333