A two-way accelerator for feature selection using a monotonic fuzzy conditional entropy

被引:6
作者
Yang, Yanyan [1 ]
Chen, Degang [2 ]
Ji, Zhenyan [1 ]
Zhang, Xiao [3 ]
Dong, Lianjie [4 ]
机构
[1] Beijing Jiaotong Univ, Sch Software Engn, Beijing, Peoples R China
[2] North China Elect Power Univ, Dept Math & Phys, Beijing, Peoples R China
[3] Xian Univ Technol, Dept Appl Math, Xian, Peoples R China
[4] Hebei Agr Univ, Coll Sci, Baoding, Peoples R China
基金
中国国家自然科学基金;
关键词
Fuzzy rough set; Feature selection; Information entropy; Sample-based accelerator; Feature-based accelerator; ATTRIBUTE REDUCTION; ROUGH SETS; ALGORITHM;
D O I
10.1016/j.fss.2024.108916
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Fuzzy rough set is a highly effective mathematical method for feature selection, which offers clear interpretability without expert knowledge. However, most of fuzzy -rough feature selection methods are to rely on all samples and candidate features during the selection of a best feature at each iteration. This often shares high computation complexity and is inefficient for large datasets. Therefore, a two-way accelerator for feature selection is presented by stepwise narrowing the search space for both samples and features. As the foundation for our accelerator, a monotonic fuzzy conditional entropy, named parameterized fuzzy granule -based conditional entropy, is first proposed to guide the feature selection process. After identifying a best feature, a sample -based accelerator is then designed to disregard redundant samples for the calculation of the newly defined entropy. A feature -based accelerator is further proposed to eliminate redundant candidate features, of which the inclusion cannot change the proposed entropy of a currently selected feature subset. Our accelerator is finally developed by integrating the sample -based accelerator with the feature -based accelerator. Experimental comparisons demonstrate the effectiveness and efficiency of the proposed two-way accelerator for feature selection.
引用
收藏
页数:18
相关论文
共 60 条
[1]   A relative uncertainty measure for fuzzy rough feature selection [J].
An, Shuang ;
Liu, Jiaying ;
Wang, Changzhong ;
Zhao, Suyun .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2021, 139 :130-142
[2]   Relative Fuzzy Rough Approximations for Feature Selection and Classification [J].
An, Shuang ;
Zhao, Enhui ;
Wang, Changzhong ;
Guo, Ge ;
Zhao, Suyun ;
Li, Piyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (04) :2200-2210
[3]   Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models [J].
Chen, Degang ;
Yang, Yanyan .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2014, 22 (05) :1325-1334
[4]   A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets [J].
Chen, Degang ;
Zhang, Lei ;
Zhao, Suyun ;
Hu, Qinghua ;
Zhu, Pengfei .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2012, 20 (02) :385-389
[5]  
Cornelis C, 2008, LECT NOTES ARTIF INT, V5009, P284, DOI 10.1007/978-3-540-79721-0_41
[6]   Attribute selection with fuzzy decision reducts [J].
Cornelis, Chris ;
Jensen, Richard ;
Hurtado, German ;
Slezak, Dominik .
INFORMATION SCIENCES, 2010, 180 (02) :209-224
[7]   Novel fuzzy ?-covering rough set models and their applications [J].
Dai, Jianhua ;
Zou, Xiongtao ;
Wu, Wei-Zhi .
INFORMATION SCIENCES, 2022, 608 :286-312
[8]   Maximal-Discernibility-Pair-Based Approach to Attribute Reduction in Fuzzy Rough Sets [J].
Dai, Jianhua ;
Hu, Hu ;
Wu, Wei-Zhi ;
Qian, Yuhua ;
Huang, Debiao .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (04) :2174-2187
[9]   Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification [J].
Dai, Jianhua ;
Xu, Qing .
APPLIED SOFT COMPUTING, 2013, 13 (01) :211-221
[10]   ROUGH FUZZY-SETS AND FUZZY ROUGH SETS [J].
DUBOIS, D ;
PRADE, H .
INTERNATIONAL JOURNAL OF GENERAL SYSTEMS, 1990, 17 (2-3) :191-209