Clustering-based k-nearest neighbor classification for large-scale data with neural codes representation

被引:74
|
作者
Gallego, Antonio-Javier [1 ]
Calvo-Zaragoza, Jorge [1 ]
Valero-Mas, Jose J. [1 ]
Rico-Juan, Juan R. [1 ]
机构
[1] Univ Alicante, Dept Lenguajes & Sistemas Informat, Carretera San Vicente Raspeig S-N, Alicante 03690, Spain
关键词
Efficient kNN classification; Clustering; Deep neural networks; ALGORITHMS; SELECTION;
D O I
10.1016/j.patcog.2017.09.038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While standing as one of the most widely considered and successful supervised classification algorithms, the k-nearest Neighbor (kNN) classifier generally depicts a poor efficiency due to being an instance-based method. In this sense, Approximated Similarity Search (ASS) stands as a possible alternative to improve those efficiency issues at the expense of typically lowering the performance of the classifier. In this paper we take as initial point an ASS strategy based on clustering. We then improve its performance by solving issues related to instances located close to the cluster boundaries by enlarging their size and considering the use of Deep Neural Networks for learning a suitable representation for the classification task at issue. Results using a collection of eight different datasets show that the combined use of these two strategies entails a significant improvement in the accuracy performance, with a considerable reduction in the number of distances needed to classify a sample in comparison to the basic kNN rule. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:531 / 543
页数:13
相关论文
共 50 条
  • [31] Evidential instance selection for K-nearest neighbor classification of big data
    Gong, Chaoyu
    Su, Zhi-gang
    Wang, Pei-hong
    Wang, Qian
    You, Yang
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2021, 138 : 123 - 144
  • [32] Graph Based K-Nearest Neighbor Minutiae Clustering for Fingerprint Recognition
    Pawar, Vaishali
    Zaveri, Mukesh
    2014 10TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION (ICNC), 2014, : 675 - 680
  • [33] A representation coefficient-based k-nearest centroid neighbor classifier
    Gou, Jianping
    Sun, Liyuan
    Du, Lan
    Ma, Hongxing
    Xiong, Taisong
    Ou, Weihua
    Zhan, Yongzhao
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 194
  • [34] A dynamic density-based clustering method based on K-nearest neighbor
    Sorkhi, Mahshid Asghari
    Akbari, Ebrahim
    Rabbani, Mohsen
    Motameni, Homayun
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (05) : 3005 - 3031
  • [35] A Local Mean Representation-based K-Nearest Neighbor Classifier
    Gou, Jianping
    Qiu, Wenmo
    Yi, Zhang
    Xu, Yong
    Mao, Qirong
    Zhan, Yongzhao
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (03)
  • [36] COLLABORATIVE REPRESENTATION BASED K-NEAREST NEIGHBOR CLASSIFIER FOR HYPERSPECTRAL IMAGERY
    Li, Wei
    Du, Qian
    Zhang, Fan
    Hu, Wei
    2014 6TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2014,
  • [37] A dynamic density-based clustering method based on K-nearest neighbor
    Mahshid Asghari Sorkhi
    Ebrahim Akbari
    Mohsen Rabbani
    Homayun Motameni
    Knowledge and Information Systems, 2024, 66 : 3005 - 3031
  • [38] Point Cloud Model Recognition and Classification Based on K-Nearest Neighbor Convolutional Neural Network
    Yu Ting
    Yang Jun
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (10)
  • [39] Processing All k-Nearest Neighbor Query on Large Multidimensional Data
    Huu Vu Lam Cao
    Trong Nhan Phan
    Minh Quang Tran
    Thanh Luan Hong
    Minh Nhat Quang Truong
    2016 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND APPLICATIONS (ACOMP), 2016, : 11 - 17
  • [40] ck-NN: A Clustered k-Nearest Neighbours Approach for Large-Scale Classification
    Ullah, Rafi
    Khan, Ayaz H.
    Emaduddin, S. M.
    ADCAIJ-ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL, 2019, 8 (03): : 67 - 77