A novel ranked k-nearest neighbors algorithm for missing data imputation

被引:0
|
作者
Khan, Yasir [1 ]
Shah, Said Farooq [2 ]
Asim, Syed Muhammad [2 ]
机构
[1] Govt Coll Management Sci Jamrud, Jamrud, KP, Pakistan
[2] Univ Peshawar, Dept Stat, Peshawar, KP, Pakistan
关键词
Imputation; k nearest neighbors; missing data; ranked set sampling;
D O I
10.1080/02664763.2024.2414357
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Missing data is a common problem in many domains that rely on data analysis. The k Nearest Neighbors imputation method has been widely used to address this issue, but it has limitations in accurately imputing missing values, especially for datasets with small pairwise correlations and small values of k. In this study, we proposed a method, Ranked k Nearest Neighbors imputation that uses a similar approach to k Nearest Neighbor, but utilizing the concept of Ranked set sampling to select the most relevant neighbors for imputation. Our results show that the proposed method outperforms the standard k nearest neighbor method in terms of imputation accuracy both in case of Missing Completely at Random and Missing at Random mechanism, as demonstrated by consistently lower MSIE and MAIE values across all datasets. This suggests that the proposed method is a promising alternative for imputing missing values in datasets with small pairwise correlations and small values of k. Thus, the proposed Ranked k Nearest Neighbor method has important implications for data imputation in various domains and can contribute to the development of more efficient and accurate imputation methods without adding any computational complexity to an algorithm.
引用
收藏
页码:1103 / 1127
页数:25
相关论文
共 50 条
  • [1] On the Use of Weighted k-Nearest Neighbors for Missing Value Imputation
    Lim, Chanhui
    Kim, Dongjae
    KOREAN JOURNAL OF APPLIED STATISTICS, 2015, 28 (01) : 23 - 31
  • [2] Differentially Private k-Nearest Neighbor Missing Data Imputation
    Clifton, Chris
    Hanson, Eric J.
    Merrill, Keith
    Merrill, Shawn
    ACM TRANSACTIONS ON PRIVACY AND SECURITY, 2022, 25 (03)
  • [3] A Hierarchical Missing Value Imputation Method by Correlation-Based K-Nearest Neighbors
    Liu, Xin
    Lai, Xiaochen
    Zhang, Liyong
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2020, 1037 : 486 - 496
  • [4] Estimation of Missing Values Using a Weighted K-Nearest Neighbors Algorithm
    Ling, Wang
    Mei, Fu Dong
    2009 INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND INFORMATION APPLICATION TECHNOLOGY, VOL III, PROCEEDINGS,, 2009, : 660 - 663
  • [5] K-nearest neighbors clustering algorithm
    Gauza, Dariusz
    Zukowska, Anna
    Nowak, Robert
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2014, 2014, 9290
  • [6] K-Nearest Neighbor (K-NN) based Missing Data Imputation
    Murti, Della Murbarani Prawidya
    Wibawa, Aji Prasetya
    Akbar, Muhammad Iqbal
    Ianto, Utomo Puj
    2019 5TH INTERNATIONAL CONFERENCE ON SCIENCE ININFORMATION TECHNOLOGY (ICSITECH): EMBRACING INDUSTRY 4.0 - TOWARDS INNOVATION IN CYBER PHYSICAL SYSTEM, 2019, : 83 - 88
  • [7] Improving k-Nearest Neighbors Algorithm for Imbalanced Data Classification
    Shi, Zhan
    3RD ANNUAL INTERNATIONAL CONFERENCE ON CLOUD TECHNOLOGY AND COMMUNICATION ENGINEERING, 2020, 719
  • [8] k-Nearest neighbors local linear regression for functional and missing data at random
    Rachdi, Mustapha
    Laksaci, Ali
    Kaid, Zoulikha
    Benchiha, Abbassia
    Al-Awadhi, Fahimah A.
    STATISTICA NEERLANDICA, 2021, 75 (01) : 42 - 65
  • [9] A NEW FUZZY K-NEAREST NEIGHBORS ALGORITHM
    Li, Chengjie
    Pei, Zheng
    Li, Bo
    Zhang, Zhen
    INTELLIGENT DECISION MAKING SYSTEMS, VOL. 2, 2010, : 246 - +
  • [10] How distance metrics influence missing data imputation with k-nearest neighbours
    Santos, Miriam Seoane
    Abreu, Pedro Henriques
    Wilk, Szymon
    Santos, Joao
    PATTERN RECOGNITION LETTERS, 2020, 136 (136) : 111 - 119