Clustering-based k-nearest neighbor classification for large-scale data with neural codes representation

被引:74
|
作者
Gallego, Antonio-Javier [1 ]
Calvo-Zaragoza, Jorge [1 ]
Valero-Mas, Jose J. [1 ]
Rico-Juan, Juan R. [1 ]
机构
[1] Univ Alicante, Dept Lenguajes & Sistemas Informat, Carretera San Vicente Raspeig S-N, Alicante 03690, Spain
关键词
Efficient kNN classification; Clustering; Deep neural networks; ALGORITHMS; SELECTION;
D O I
10.1016/j.patcog.2017.09.038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While standing as one of the most widely considered and successful supervised classification algorithms, the k-nearest Neighbor (kNN) classifier generally depicts a poor efficiency due to being an instance-based method. In this sense, Approximated Similarity Search (ASS) stands as a possible alternative to improve those efficiency issues at the expense of typically lowering the performance of the classifier. In this paper we take as initial point an ASS strategy based on clustering. We then improve its performance by solving issues related to instances located close to the cluster boundaries by enlarging their size and considering the use of Deep Neural Networks for learning a suitable representation for the classification task at issue. Results using a collection of eight different datasets show that the combined use of these two strategies entails a significant improvement in the accuracy performance, with a considerable reduction in the number of distances needed to classify a sample in comparison to the basic kNN rule. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:531 / 543
页数:13
相关论文
共 50 条
  • [41] The Spatial Classification Algorithm of K-Nearest Neighbor Based on Spatial Predicate
    Ma Yu
    Gao Yuling
    Song Shaoyun
    MECHATRONICS AND INTELLIGENT MATERIALS III, PTS 1-3, 2013, 706-708 : 1928 - +
  • [42] Evidential classification of incomplete instance based on K-nearest centroid neighbor
    Ma, Zong-fang
    Liu, Zhe
    Luo, Chan
    Song, Lin
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (06) : 7101 - 7115
  • [43] Evidential classification of incomplete instance based on K-nearest centroid neighbor
    Ma, Zong-Fang
    Liu, Zhe
    Luo, Chan
    Song, Lin
    Liu, Zhe (liuzhe921@gmail.com), 1600, IOS Press BV (41): : 7101 - 7115
  • [44] Quantum K-nearest neighbor classification algorithm based on Hamming distance
    Jing Li
    Song Lin
    Kai Yu
    Gongde Guo
    Quantum Information Processing, 2022, 21
  • [45] Quantum K-nearest neighbor classification algorithm based on Hamming distance
    Li, Jing
    Lin, Song
    Yu, Kai
    Guo, Gongde
    QUANTUM INFORMATION PROCESSING, 2022, 21 (01)
  • [46] A Localization Algorithm Based on Compressive Sensing by K-nearest Neighbor Classification
    Yang, Sixing
    Guo, Yan
    Liu, Xi
    Niu, Dawei
    Sun, Baoming
    PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 863 - 867
  • [47] A quick evidential classification algorithm based on K-nearest neighbor rule
    Wang, Z
    Hu, WD
    Yu, WX
    2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, : 3248 - 3252
  • [48] A new belief-based K-nearest neighbor classification method
    Liu, Zhun-ga
    Pan, Quan
    Dezert, Jean
    PATTERN RECOGNITION, 2013, 46 (03) : 834 - 844
  • [49] Infrared Face Recognition Based on Histogram and K-Nearest Neighbor Classification
    Wang, Shangfei
    Liu, Zhilei
    ADVANCES IN NEURAL NETWORKS - ISNN 2010, PT 2, PROCEEDINGS, 2010, 6064 : 104 - 111
  • [50] Distributed nearest neighbor classification for large-scale multi-label data on spark
    Gonzalez-Lopez, Jorge
    Ventura, Sebastian
    Cano, Alberto
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 : 66 - 82