A novel ranked k-nearest neighbors algorithm for missing data imputation

被引:0
作者
Khan, Yasir [1 ]
Shah, Said Farooq [2 ]
Asim, Syed Muhammad [2 ]
机构
[1] Govt Coll Management Sci Jamrud, Jamrud, KP, Pakistan
[2] Univ Peshawar, Dept Stat, Peshawar, KP, Pakistan
关键词
Imputation; k nearest neighbors; missing data; ranked set sampling;
D O I
10.1080/02664763.2024.2414357
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Missing data is a common problem in many domains that rely on data analysis. The k Nearest Neighbors imputation method has been widely used to address this issue, but it has limitations in accurately imputing missing values, especially for datasets with small pairwise correlations and small values of k. In this study, we proposed a method, Ranked k Nearest Neighbors imputation that uses a similar approach to k Nearest Neighbor, but utilizing the concept of Ranked set sampling to select the most relevant neighbors for imputation. Our results show that the proposed method outperforms the standard k nearest neighbor method in terms of imputation accuracy both in case of Missing Completely at Random and Missing at Random mechanism, as demonstrated by consistently lower MSIE and MAIE values across all datasets. This suggests that the proposed method is a promising alternative for imputing missing values in datasets with small pairwise correlations and small values of k. Thus, the proposed Ranked k Nearest Neighbor method has important implications for data imputation in various domains and can contribute to the development of more efficient and accurate imputation methods without adding any computational complexity to an algorithm.
引用
收藏
页码:1103 / 1127
页数:25
相关论文
共 50 条
[31]   Incremental k-Nearest Neighbors Using Reservoir Sampling for Data Streams [J].
Bahri, Maroua ;
Bifet, Albert .
DISCOVERY SCIENCE (DS 2021), 2021, 12986 :122-137
[32]   K-Nearest Neighbors Classifier for Field Bit Error Rate Data [J].
Allogba, Stephanie ;
Tremblay, Christine .
2018 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP), 2018,
[33]   NS-kNN: a modified k-nearest neighbors approach for imputing metabolomics data [J].
Justin Y. Lee ;
Mark P. Styczynski .
Metabolomics, 2018, 14
[34]   Hypersphere anchor loss for K-Nearest neighbors [J].
Xiang Ye ;
Zihang He ;
Heng Wang ;
Yong Li .
Applied Intelligence, 2023, 53 :30319-30328
[35]   AutoML for Stream k-Nearest Neighbors Classification [J].
Bahri, Maroua ;
Veloso, Bruno ;
Bifet, Albert ;
Gama, Joao .
2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, :597-602
[36]   Combining Fourier and lagged k-nearest neighbor imputation for biomedical time series data [J].
Rahman, Shah Atiqur ;
Huang, Yuxiao ;
Claassen, Jan ;
Heintzman, Nathaniel ;
Kleinberg, Samantha .
JOURNAL OF BIOMEDICAL INFORMATICS, 2015, 58 :198-207
[37]   Hypersphere anchor loss for K-Nearest neighbors [J].
Ye, Xiang ;
He, Zihang ;
Wang, Heng ;
Li, Yong .
APPLIED INTELLIGENCE, 2023, 53 (24) :30319-30328
[38]   A Novel Classification Algorithm Based on the Synergy Between Dynamic Clustering with Adaptive Distances and K-Nearest Neighbors [J].
Sabri, Mohammed ;
Verde, Rosanna ;
Balzanella, Antonio ;
Maturo, Fabrizio ;
Tairi, Hamid ;
Yahyaouy, Ali ;
Riffi, Jamal .
JOURNAL OF CLASSIFICATION, 2024, 41 (02) :264-288
[39]   Unsupervised image clustering algorithm based on contrastive learning and K-nearest neighbors [J].
Zhang, Xiuling ;
Wang, Shuo ;
Wu, Ziyun ;
Tan, Xiaofei .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (09) :2415-2423
[40]   A novel density peaks clustering algorithm for automatic selection of clustering centers based on K-nearest neighbors [J].
Wang, Zhihe ;
Wang, Huan ;
Du, Hui ;
Chen, Shiyin ;
Shi, Xinxin .
MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (07) :11875-11894