A geometric density-based sample reduction method

被引:0
|
作者
Mohammadi, Mahdi [1 ]
Raahemi, Bijan [1 ]
Akbari, Ahmad [2 ]
机构
[1] Univ Ottawa, Knowledge Discovery & Data Min Lab, Ottawa, ON K1N 6N5, Canada
[2] Iran Univ Sci & Technol, Dept Comp Engn, Tehran, Iran
关键词
Sample reduction; clustering; classification; density-based; membership function;
D O I
10.3233/IDA-150780
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Analysis of network traffic, financial transactions, and mobile communications are examples of applications where examining entire samples of a large dataset is computationally expensive, and requires significant memory space. A common approach to address this challenge is to reduce the number of samples without compromising the accuracy of analyzing them. In this paper, we propose a new cluster-based sample reduction method which is unsupervised, geometric, and density-based. The original data is initially divided into clusters, and each cluster is divided into "portions" defined as the areas between two concentric circles. Then, using the proposed geometric-based formulas, the selection value of each sample belonging to a specific portion is calculated. Samples are then selected from the original data according to the corresponding calculated selection value. The performance of the proposed method is measured on various datasets and compared with several cluster-based and density-based methods. We conduct various experiments on the NSL-KDD, KDDCup99, and IUSTsip datasets, and evaluate the performance of the proposed method by measuring the cluster validity indices, as well as the accuracy of the classifier applied on the reduced data. We demonstrate that the reduced dataset has similar sample scattering as that of the original dataset. We also demonstrate that, while reducing the sample size of the input dataset in half, the classification accuracy is not reduced significantly, indicating that the proposed method selects the most relevant samples from the original dataset.
引用
收藏
页码:1233 / 1257
页数:25
相关论文
共 50 条
  • [41] A Density-Based Adaptive Quantum Mechanical/Molecular Mechanical Method
    Waller, Mark P.
    Kumbhar, Sadhana
    Yang, Jack
    CHEMPHYSCHEM, 2014, 15 (15) : 3218 - 3225
  • [42] Density-based Data Pruning Method for Deep Reinforcement Learning
    Rojanaarpa, Teerapat
    Kataeva, Irina
    2016 15TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2016), 2016, : 266 - 271
  • [43] A simple approximate density-based phase envelope construction method
    Nichita, Dan Vladimir
    FLUID PHASE EQUILIBRIA, 2019, 499
  • [44] A dynamic density-based clustering method based on K-nearest neighbor
    Mahshid Asghari Sorkhi
    Ebrahim Akbari
    Mohsen Rabbani
    Homayun Motameni
    Knowledge and Information Systems, 2024, 66 : 3005 - 3031
  • [45] Density-based label placement
    Lhuillier, Antoine
    van Garderen, Mereke
    Weiskopf, Daniel
    VISUAL COMPUTER, 2019, 35 (6-8): : 1041 - 1052
  • [46] Density-based algorithm in MapReduce
    Pang Lin
    Liu Fang-ai
    PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2016, : 394 - 397
  • [47] Density-based view materialization
    Das, A
    Bhattacharyya, DK
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PROCEEDINGS, 2005, 3776 : 589 - 594
  • [48] Density-based spam detector
    Yoshida, K
    Adachi, F
    Washio, T
    Motoda, H
    Homma, T
    Nakashima, A
    Fujikawa, H
    Yamazaki, K
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2004, E87D (12): : 2678 - 2688
  • [49] Density-Based Clustering with Constraints
    Lasek, Piotr
    Gryz, Jarek
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2019, 16 (02) : 469 - 489
  • [50] Density-Based Clustering of Polygons
    Joshi, Deepti
    Samal, Ashok K.
    Soh, Leen-Kiat
    2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 171 - 178