A novel outlier detecting algorithm based on the outlier turning points

被引:14
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] An Optimized Pruning-based Outlier Detecting algorithm
    Wang, Jinghua
    Zhao, Xinxiang
    Jin, Peng
    Zhang, Guoyan
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4, 2013, 411-414 : 1076 - 1080
  • [2] A Novel Algorithm for Detecting Spatial-Temporal Trajectory Outlier
    Lv, Shenglan
    Zhang, Yifan
    Ji, Genlin
    Zhao, Bin
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ELECTRONIC TECHNOLOGY, 2016, 48 : 184 - 190
  • [3] A novel algorithm for outlier removal based on density
    Wang Y.
    Zidonghua Xuebao/ Acta Automatica Sinica, 2010, 36 (02): : 343 - 346
  • [4] A Novel Cluster Based Algorithm for Outlier Detection
    Mahajan, Manish
    Kumar, Santosh
    Pant, Bhasker
    COMPUTING, COMMUNICATION AND SIGNAL PROCESSING, ICCASP 2018, 2019, 810 : 449 - 456
  • [5] An outlier detection algorithm based on an integrated outlier factor
    Zhou, Hongfang
    Liu, Hongjiang
    Zhang, Yingjie
    Zhang, Yao
    INTELLIGENT DATA ANALYSIS, 2019, 23 (05) : 975 - 990
  • [6] Cell-based outlier detection algorithm: A fast outlier detection algorithm for large datasets
    Wan, You
    Bian, Fuling
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2008, 5012 : 1042 - 1048
  • [7] Algorithm based on partition for outlier detection
    School of Information Science and Engineering, Northeastern University, Shenyang 110006, China
    不详
    Ruan Jian Xue Bao, 2006, 5 (1009-1016): : 1009 - 1016
  • [8] SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor
    Zhang, Zhongping
    Wang, Kuo
    Dong, Jinyu
    Li, Sen
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [9] Depth-Based Outlier Detection Algorithm
    Cardenas-Montes, Miguel
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, HAIS 2014, 2014, 8480 : 122 - 132
  • [10] An Effective Algorithm of Outlier Detection Based on Clustering
    Xia, Qingsong
    Xing, Changzheng
    Li, Na
    INTERNET OF THINGS-BK, 2012, 312 : 346 - 351