Outlier detection using neighborhood rank difference

被引:38
作者
Bhattacharya, Gautam [1 ]
Ghosh, Koushik [2 ]
Chowdhury, Ananda S. [3 ]
机构
[1] Univ Burdwan, Univ Inst Technol, Dept Phys, Burdwan 713104, W Bengal, India
[2] Univ Burdwan, Univ Inst Technol, Dept Math, Burdwan 713104, W Bengal, India
[3] Jadavpur Univ, Dept Elect & Telecommun Engn, Kolkata 700032, India
关键词
Outlier; Rank-difference; kNN; RNN; ANOMALY DETECTION;
D O I
10.1016/j.patrec.2015.04.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Presence of outliers critically affects many pattern classification tasks. In this paper, we propose a novel dynamic outlier detection method based on neighborhood rank difference. In particular, reverse and the forward nearest neighbor rank difference is employed to capture the variations in densities of a test point with respect to various training points. In the first step of our method, we determine the influence space for a given dataset. A score for outlierness is proposed in the second step using the rank difference as well as the absolute density within this influence space. Experiments on synthetic and some UCI machine learning repository datasets clearly indicate the supremacy of our method over some recently published approaches. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:24 / 31
页数:8
相关论文
共 31 条
[1]  
Aggarwal C. C, 2015, Outlier analysis, DOI [DOI 10.1007/978-1-4614-6396-2, 10.1007/978-1-4614-6396-2]
[2]  
Aggrwal S., 2013, INT J ADV RES ENG TE, V1
[3]  
Arribas-Gil A., 2014, BIOSTATISTICS, V11, P1
[4]  
Bolton R.J., 2001, Control, VVII, P235
[5]  
BOWMAN A. W., 1997, Applied Smoothing Techniques for Data Analysis
[6]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[7]   Neighborhood outlier detection [J].
Chen, Yumin ;
Miao, Duoqian ;
Zhang, Hongyun .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8745-8749
[8]   Improved peak detection and quantification of mass spectrometry data acquired from surface-enhanced laser desorption and ionization by denoising spectra with the undecimated discrete wavelet transform [J].
Coombes, KR ;
Tsavachidis, S ;
Morris, JS ;
Baggerly, KA ;
Hung, MC ;
Kuerer, HM .
PROTEOMICS, 2005, 5 (16) :4107-4117
[9]   AN INTRUSION-DETECTION MODEL [J].
DENNING, DE .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1987, 13 (02) :222-232
[10]   A Discriminative Metric Learning Based Anomaly Detection Method [J].
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (11) :6844-6857