An Optimized Pruning-based Outlier Detecting algorithm

被引:0
作者
Wang, Jinghua [1 ]
Zhao, Xinxiang [1 ]
Jin, Peng [1 ]
Zhang, Guoyan [1 ]
机构
[1] Cent China Normal Univ, Acad Comp Sci, Wuhan, Hubei, Peoples R China
来源
INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4 | 2013年 / 411-414卷
关键词
Data mining; Outlier detection; Pruning; Clustering;
D O I
10.4028/www.scientific.net/AMM.411-414.1076
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
An Optimized Pruning-based Outlier Detecting algorithm is proposed based on the density-based outlier detecting algorithm (LOF algorithm). The calculation accuracy and the time complexity of LOP algorithm are not ideal, so two steps are taken to reduce the amount of calculation and improve the calculation accuracy for LOF algorithm. Firstly, using cluster pruning technique to preprocess data set, at the same time filtering the non-outliers based on the differences of cluster models to avoid the error pruning of outliers located at the edge of clusters, different cluster models are output by inputing multiple parameters in the DBSCAN algorithm. Secondly,optimize the query process of the neighborhood (epsilon - neighbor and k- neighbor). After pruning, local outlier factors are calculated only for the data objects out of clusters. Experimental results show that the algorithm proposed in this paper can improve the outlier detection accuracy, reduce the time complexity and realize the effective local outlier detection.
引用
收藏
页码:1076 / 1080
页数:5
相关论文
共 50 条
  • [31] A dynamic auto-stopped clustering algorithm based on outlier information
    Lv, TY
    Huang, SB
    Zuo, WL
    Wang, ZX
    Proceedings of the 8th Joint Conference on Information Sciences, Vols 1-3, 2005, : 1501 - 1504
  • [32] Depth-Based Outlier Detection Algorithm
    Cardenas-Montes, Miguel
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, HAIS 2014, 2014, 8480 : 122 - 132
  • [33] An Outlier Mining Algorithm Based on Attribute Entropy
    Zhou, Ming-Jian
    Tao, Jun-cai
    2011 2ND INTERNATIONAL CONFERENCE ON CHALLENGES IN ENVIRONMENTAL SCIENCE AND COMPUTER ENGINEERING (CESCE 2011), VOL 11, PT A, 2011, 11 : 132 - 138
  • [34] An incremental outlier factor based clustering algorithm
    Zhou, YF
    Liu, QB
    Deng, S
    Yang, Q
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 1358 - 1361
  • [35] A new Algorithm for Outlier Detection based on Offset
    Zhang, Yue
    Liu, Jie
    Song, Bo
    FIFTH INTERNATIONAL CONFERENCE ON INFORMATION ASSURANCE AND SECURITY, VOL 2, PROCEEDINGS, 2009, : 3 - 6
  • [36] A novel algorithm for outlier removal based on density
    Wang Y.
    Zidonghua Xuebao/ Acta Automatica Sinica, 2010, 36 (02): : 343 - 346
  • [37] An Outlier Detection Algorithm Based on Differential Privacy
    Shou, Zhaoyu
    Yan, Ye
    Zou, Fengbo
    FUZZY SYSTEMS AND DATA MINING V (FSDM 2019), 2019, 320 : 984 - 990
  • [38] Comparative performance analysis of epsilon-insensitive and pruning-based algorithms for sparse least squares support vector regression
    Karal, Omer
    SIGMA JOURNAL OF ENGINEERING AND NATURAL SCIENCES-SIGMA MUHENDISLIK VE FEN BILIMLERI DERGISI, 2024, 42 (02): : 578 - 589
  • [39] A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor
    Zhang, ZhongPing
    Li, Sen
    Liu, WeiXiong
    Wang, Ying
    Li, Daisy Xin
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (02)
  • [40] Outlier Detection Using a GPU-Based Parallel Algorithm: Quantum Clustering
    Liu, Ding
    Wang, Zhe
    Li, Hui
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2024, 33 (04)