A novel outlier detecting algorithm based on the outlier turning points

被引:14
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Cluster Based Outlier Detection Algorithm For Healthcare Data
    Christy, A.
    MeeraGandhi, G.
    Vaithyasubramanian, S.
    BIG DATA, CLOUD AND COMPUTING CHALLENGES, 2015, 50 : 209 - 215
  • [42] A New Outlier Detection Algorithm Based on Manifold Learning
    Tang, Zhigang
    Yang, Jun
    Yang, Bingru
    2010 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-5, 2010, : 452 - 457
  • [43] An outlier detection algorithm based on local density feedback
    Zhang, Zhongping
    Hou, Yuehan
    Jia, Yin
    Zhang, Ruibo
    KNOWLEDGE AND INFORMATION SYSTEMS, 2025, : 3599 - 3629
  • [44] Outlier detection based on cluster outlier factor and mutual density
    Zhang Z.
    Zhu M.
    Qiu J.
    Liu C.
    Zhang D.
    Qi J.
    International Journal of Intelligent Information and Database Systems, 2019, 12 (1-2) : 91 - 108
  • [45] A Novel Unsupervised Outlier Detection Algorithm Based on Mutual Information and Reduced Spectral Clustering
    Huang, Yuehua
    Liu, Wenfen
    Li, Song
    Guo, Ying
    Chen, Wen
    ELECTRONICS, 2023, 12 (23)
  • [46] LDBOD: A novel local distribution based outlier detector
    Zhang, Yong
    Yang, Su
    Wang, Yuanyuan
    PATTERN RECOGNITION LETTERS, 2008, 29 (07) : 967 - 976
  • [47] Detecting Outlier Sections in US Congressional Legislation
    Aktolga, Elif
    Ros, Irene
    Assogba, Yannick
    PROCEEDINGS OF THE 34TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR'11), 2011, : 235 - 244
  • [48] Resolution-based outlier factor: detecting the top-n most outlying data points in engineering data
    Fan, Hongqin
    Zaiane, Osmar R.
    Foss, Andrew
    Wu, Junfeng
    KNOWLEDGE AND INFORMATION SYSTEMS, 2009, 19 (01) : 31 - 51
  • [49] A Novel Isolation-Based Outlier Detection Method
    Shen, Yanhui
    Liu, Huawen
    Wang, Yanxia
    Chen, Zhongyu
    Sun, Guanghua
    PRICAI 2016: TRENDS IN ARTIFICIAL INTELLIGENCE, 2016, 9810 : 446 - 456
  • [50] Resolution-based outlier factor: detecting the top-n most outlying data points in engineering data
    Hongqin Fan
    Osmar R. Zaïane
    Andrew Foss
    Junfeng Wu
    Knowledge and Information Systems, 2009, 19 : 31 - 51