An Optimized Pruning-based Outlier Detecting algorithm

被引:0
作者
Wang, Jinghua [1 ]
Zhao, Xinxiang [1 ]
Jin, Peng [1 ]
Zhang, Guoyan [1 ]
机构
[1] Cent China Normal Univ, Acad Comp Sci, Wuhan, Hubei, Peoples R China
来源
INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4 | 2013年 / 411-414卷
关键词
Data mining; Outlier detection; Pruning; Clustering;
D O I
10.4028/www.scientific.net/AMM.411-414.1076
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
An Optimized Pruning-based Outlier Detecting algorithm is proposed based on the density-based outlier detecting algorithm (LOF algorithm). The calculation accuracy and the time complexity of LOP algorithm are not ideal, so two steps are taken to reduce the amount of calculation and improve the calculation accuracy for LOF algorithm. Firstly, using cluster pruning technique to preprocess data set, at the same time filtering the non-outliers based on the differences of cluster models to avoid the error pruning of outliers located at the edge of clusters, different cluster models are output by inputing multiple parameters in the DBSCAN algorithm. Secondly,optimize the query process of the neighborhood (epsilon - neighbor and k- neighbor). After pruning, local outlier factors are calculated only for the data objects out of clusters. Experimental results show that the algorithm proposed in this paper can improve the outlier detection accuracy, reduce the time complexity and realize the effective local outlier detection.
引用
收藏
页码:1076 / 1080
页数:5
相关论文
共 50 条
  • [1] PSO clustering and pruning-based KNN for outlier detection
    Mayanglambam, Sushilata D.
    Horng, Shi-Jinn
    Pamula, Rajendra
    SOFT COMPUTING, 2023,
  • [2] Pruning-based identification of domain ontologies
    Volz, R
    Studer, R
    Maedche, A
    Lauser, B
    JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2003, 9 (06) : 520 - 529
  • [3] A novel outlier detecting algorithm based on the outlier turning points
    Huang, Jinlong
    Cheng, Dongdong
    Zhang, Sulan
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [4] An Effective Algorithm of Outlier Detection Based on Clustering
    Xia, Qingsong
    Xing, Changzheng
    Li, Na
    INTERNET OF THINGS-BK, 2012, 312 : 346 - 351
  • [5] PME: pruning-based multi-size embedding for recommender systems
    Liu, Zirui
    Song, Qingquan
    Li, Li
    Choi, Soo-Hyun
    Chen, Rui
    Hu, Xia
    FRONTIERS IN BIG DATA, 2023, 6
  • [6] Smart DAG Task Scheduling with Efficient Pruning-based MCTS Method
    Liu, Kui
    Wu, Zhiwei
    Wu, Qing
    Cheng, Yuxia
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 348 - 355
  • [7] Iterative Pruning-based Model Compression for Pose Estimation on Resource-constrained Devices
    Choi, Sunghyun
    Choi, Wonje
    Lee, Youngseok
    Woo, Honguk
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, ICMVA 2022, 2022, : 110 - 115
  • [8] Algorithm based on partition for outlier detection
    School of Information Science and Engineering, Northeastern University, Shenyang 110006, China
    不详
    Ruan Jian Xue Bao, 2006, 5 (1009-1016): : 1009 - 1016
  • [9] Diabetes Prediction Medicament using Optimized SVM algorithm with Outlier detection and removal
    Kanmani, K.
    Murugan, A.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (05): : 539 - 544
  • [10] A sequential outlier detecting method using a clustering algorithm
    Seo, Han Son
    Yoon, Min
    KOREAN JOURNAL OF APPLIED STATISTICS, 2016, 29 (04) : 699 - 706