Weighted rank aggregation based on ranker accuracies for feature selection

被引:0
作者
Majid Abdolrazzagh-Nezhad [1 ]
Mahdi Kherad [2 ]
机构
[1] Faculty of Engineering, Department of Computer Engineering, Bozorgmehr University of Qaenat, Qaen
[2] Department of Computer Science, Faculty of Computer and Industrial Engineering, Birjand University of Technology, Birjand
[3] Faculty of Engineering, Department of Computer Engineering, University of Qom, Qom
关键词
Agreement/disagreements; Feature selection; Filter-based methods; Rank aggregation;
D O I
10.1007/s00500-025-10530-1
中图分类号
学科分类号
摘要
Rank aggregation is the combination of several ranked lists from a set of candidates to achieve a better ranking by combining information from different sources. In feature selection problem, due to the heterogeneity of methods, there are some base rankers (Filter-based methods) that are of diverse quality and usually the ground truth of ratings is not available. Existing rank aggregation methods that take the diverse quality of base rankers into account do not have any explicit approach for appropriate weighting, require prior assumptions, and suffers from high computational complexity. In this paper, to overcome these challenges, an efficient unsupervised method is introduced for estimating the base rankers’ qualities and aggregating the rankers based on the estimated weights. We first compute the ratio of disagreement between base rankers in ordering different element pairs and then estimate the accuracies in a way that to minimize the discrepancy between these computed ratios and their analytical counterparts. We use the weighted majority voting method for obtaining the aggregated results. To resolve the probable inconsistencies in the final aggregation, the result is formed as a graph, and a greedy algorithm is used to find an acyclic subgraph with the highest weigh. To demonstrate the performance of the proposed method, nine standard UCI datasets are used. The obtained results by the proposed method have higher values of classifier measures than the existing baseline Feature Selection methods and rank aggregation-based multi-filter methods in the most datasets. The experiments show that rank aggregation-based Feature Selection methods outperform individual methods. The proposed method also shows the weight of each Filter-based Feature Selection method, in which the MRMR method has a higher weight than other methods. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.
引用
收藏
页码:1981 / 2001
页数:20
相关论文
共 62 条
  • [1] Aledo J.A., Gamez J.A., Molina D., Approaching the rank aggregation problem by local search-based metaheuristics, J Comput Appl Math, 354, pp. 445-456, (2019)
  • [2] Amirkhani H., Rahmati M., Agreement/disagreement based crowd labeling, Appl Intell, 41, 1, pp. 212-222, (2014)
  • [3] Amirkhani H., Rahmati M., Expectation maximization based ordering aggregation for improving the K2 structure learning algorithm, Intell Data Anal, 19, 5, pp. 1003-1018, (2015)
  • [4] Amirkhani H., Rahmati M., Lucas P.J., Hommersom A., Exploiting experts’ knowledge for structure learning of Bayesian networks, IEEE Trans Pattern Anal Mach Intell, 39, 11, pp. 2154-2170, (2016)
  • [5] Aslam J.A., Montague M., Models for metasearch, Proceedings of the 24Th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval2001: ACM, pp. 276-284, (2001)
  • [6] Asuncion A., Newman D., UCI machine learning repository, (2007)
  • [7] Azhagusundari B., Thanamani A.S., Feature selection based on information gain, Int J Innov Technol Expl Eng, 2, 2, pp. 18-21, (2013)
  • [8] Badgeley M.A., Sealfon S.C., Chikina M.D., Hybrid Bayesian-rank integration approach improves the predictive power of genomic dataset aggregation, Bioinformatics, 31, 2, pp. 209-215, (2014)
  • [9] Bahassine S., Madani A., Al-Sarem M., Kissi M., Feature selection using an improved Chi-square for Arabic text classification, J King Saud Univ Comput Inf Sci, 32, 2, pp. 225-231, (2020)
  • [10] Balogun A.O., Et al., Impact of feature selection methods on the predictive performance of software defect prediction models: an extensive empirical study, Symmetry, 12, 7, (2020)