A geometric density-based sample reduction method

被引:0
|
作者
Mohammadi, Mahdi [1 ]
Raahemi, Bijan [1 ]
Akbari, Ahmad [2 ]
机构
[1] Univ Ottawa, Knowledge Discovery & Data Min Lab, Ottawa, ON K1N 6N5, Canada
[2] Iran Univ Sci & Technol, Dept Comp Engn, Tehran, Iran
关键词
Sample reduction; clustering; classification; density-based; membership function;
D O I
10.3233/IDA-150780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Analysis of network traffic, financial transactions, and mobile communications are examples of applications where examining entire samples of a large dataset is computationally expensive, and requires significant memory space. A common approach to address this challenge is to reduce the number of samples without compromising the accuracy of analyzing them. In this paper, we propose a new cluster-based sample reduction method which is unsupervised, geometric, and density-based. The original data is initially divided into clusters, and each cluster is divided into "portions" defined as the areas between two concentric circles. Then, using the proposed geometric-based formulas, the selection value of each sample belonging to a specific portion is calculated. Samples are then selected from the original data according to the corresponding calculated selection value. The performance of the proposed method is measured on various datasets and compared with several cluster-based and density-based methods. We conduct various experiments on the NSL-KDD, KDDCup99, and IUSTsip datasets, and evaluate the performance of the proposed method by measuring the cluster validity indices, as well as the accuracy of the classifier applied on the reduced data. We demonstrate that the reduced dataset has similar sample scattering as that of the original dataset. We also demonstrate that, while reducing the sample size of the input dataset in half, the classification accuracy is not reduced significantly, indicating that the proposed method selects the most relevant samples from the original dataset.
引用
收藏
页码:1233 / 1257
页数:25
相关论文
共 50 条
  • [21] Density-Based Geometric One-Class Classifier Combined with Genetic Algorithm
    Kim, Do Gyun
    Choi, Jin Young
    Mathematical Problems in Engineering, 2022, 2022
  • [22] Density-Based Geometric One-Class Classifier Combined with Genetic Algorithm
    Kim, Do Gyun
    Choi, Jin Young
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [23] Density-Based Geometric One-Class Classifier Combined with Genetic Algorithm
    Kim, Do Gyun
    Choi, Jin Young
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [24] A density-based topology optimization method using radial basis function and its design variable reduction
    Shi, Shangjun
    Zhou, Pingzhang
    Lu, Zhenhua
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2021, 64 (04) : 2149 - 2163
  • [25] A density-based topology optimization method using radial basis function and its design variable reduction
    Shangjun Shi
    Pingzhang Zhou
    Zhenhua Lü
    Structural and Multidisciplinary Optimization, 2021, 64 : 2149 - 2163
  • [26] Density-based clustering
    Campello, Ricardo J. G. B.
    Kroeger, Peer
    Sander, Jorg
    Zimek, Arthur
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 10 (02)
  • [27] Density-based motion
    Etemadpour, Ronak
    Forbes, Angus Graeme
    INFORMATION VISUALIZATION, 2017, 16 (01) : 3 - 20
  • [28] Density-based clustering
    Kriegel, Hans-Peter
    Kroeger, Peer
    Sander, Joerg
    Zimek, Arthur
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2011, 1 (03) : 231 - 240
  • [29] Novel density-based and hierarchical density-based clustering algorithms for uncertain data
    Zhang, Xianchao
    Liu, Han
    Zhang, Xiaotong
    NEURAL NETWORKS, 2017, 93 : 240 - 255
  • [30] A PRI estimation and signal deinterleaving method based on density-based clustering
    Wang L.
    Zhang Z.
    Li T.
    Zhang T.
    International Journal of Information and Communication Technology, 2024, 24 (01) : 72 - 85