A novel outlier detecting algorithm based on the outlier turning points

被引:14
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] A Novel k-means Algorithm for Clustering and Outlier Detection
    Zhou, Yinghua
    Yu, Hong
    Cai, Xuemei
    2009 SECOND INTERNATIONAL CONFERENCE ON FUTURE INFORMATION TECHNOLOGY AND MANAGEMENT ENGINEERING, FITME 2009, 2009, : 476 - +
  • [32] A Comparative Study of Cluster Based Outlier Detection, Distance Based Outlier Detection and Density Based Outlier Detection Techniques
    Mandhare, Harshada C.
    Idate, S. R.
    2017 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND CONTROL SYSTEMS (ICICCS), 2017, : 931 - 935
  • [33] Outlier detection algorithm based on fluctuation of centroid projection
    Zhang Z.
    Zhang Y.
    Liu W.
    Deng Y.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2022, 28 (12): : 3869 - 3878
  • [34] KNN Based Outlier Detection Algorithm in Large Dataset
    Yang, Peng
    Huang, Biao
    2008 INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND TRAINING AND 2008 INTERNATIONAL WORKSHOP ON GEOSCIENCE AND REMOTE SENSING, VOL 1, PROCEEDINGS, 2009, : 611 - 613
  • [35] An Outlier Detection Algorithm Based on Probability Density Clustering
    Wang, Wei
    Ren, Yongjian
    Zhou, Renjie
    Zhang, Jilin
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (01) : 22 - 22
  • [36] Algorithm for spatial outlier detection based on outlying degree
    Xue, Anrong
    Ju, Shiguang
    WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 6005 - +
  • [37] A Data Stream Outlier Detection Algorithm Based on Grid
    Yu Xiang
    Lei Guohua
    Xu Xiandong
    Lin Liandong
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 4136 - 4141
  • [38] INOD: A Graph-Based Outlier Detection Algorithm
    Yang, Lihua
    Li, Guilin
    Zhou, Shaobin
    Liao, Minghong
    SENSORS, MEASUREMENT AND INTELLIGENT MATERIALS II, PTS 1 AND 2, 2014, 475-476 : 1008 - 1012
  • [39] Outlier detection model modified based on MOPSO algorithm
    Gao, Bo
    Chai, Xueke
    Zhu, Minghao
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (07): : 2319 - 2327
  • [40] TLE outlier detection based on expectation maximization algorithm
    Liu, Jinghong
    Liu, Lei
    Du, Jianli
    Sang, Jizhang
    ADVANCES IN SPACE RESEARCH, 2021, 68 (07) : 2695 - 2712