Feature selection based on fuzzy joint mutual information maximization

被引:7
作者
Salem, Omar A. M. [1 ,2 ]
Liu, Feng [1 ]
Sherif, Ahmed Sobhy [2 ]
Zhang, Wen [3 ]
Chen, Xi [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Suez Canal Univ, Fac Comp & Informat, Ismailia 41522, Egypt
[3] Huazhong Agr Univ, Coll Informat, Wuhan 430070, Peoples R China
关键词
mutual information; fuzzy sets; fuzzy mutual information; feature selection; classification systems; MAX-RELEVANCE; UNCERTAINTY;
D O I
10.3934/mbe.2021016
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Nowadays, real-world applications handle a huge amount of data, especially with high dimension features space. These datasets are a significant challenge for classification systems. Unfortunately, most of the features present are irrelevant or redundant, thus making these systems inefficient and inaccurate. For this reason, many feature selection (FS) methods based on information theory have been introduced to improve the classification performance. However, the current methods have some limitations such as dealing with continuous features, estimating the redundancy.relations, and considering the outer-class information. To overcome these limitations, this paper presents a. new FS method, called Fuzzy Joint Mutual Information Maximization (EIMIM). The effectiveness of our proposed method is verified by conducting an experimental comparison with nine conventional and state-of-the-art feature selection methods. Based on 13 benchmark datascts, experimental results confirm that our proposed method leads to promising improvement in classification performance and feature selection stability.
引用
收藏
页码:305 / 327
页数:23
相关论文
共 50 条
[21]   A Powerful Feature Selection approach based on Mutual Information [J].
El Akadi, Ali ;
El Ouardighi, Abdeljalil ;
Aboutajdine, Driss .
INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2008, 8 (04) :116-121
[22]   Feature selection based on mutual information with correlation coefficient [J].
Hongfang Zhou ;
Xiqian Wang ;
Rourou Zhu .
Applied Intelligence, 2022, 52 :5457-5474
[23]   FEATURE SELECTION BASED ON STATISTICAL ESTIMATION OF MUTUAL INFORMATION [J].
Kozhevin, A. A. .
SIBERIAN ELECTRONIC MATHEMATICAL REPORTS-SIBIRSKIE ELEKTRONNYE MATEMATICHESKIE IZVESTIYA, 2021, 18 :720-728
[24]   Mutual information-based feature selection for radiomics [J].
Oubel, Estanislao ;
Beaumont, Hubert ;
Iannessi, Antoine .
MEDICAL IMAGING 2016: PACS AND IMAGING INFORMATICS: NEXT GENERATION AND INNOVATIONS, 2016, 9789
[25]   A review of feature selection methods based on mutual information [J].
Vergara, Jorge R. ;
Estevez, Pablo A. .
NEURAL COMPUTING & APPLICATIONS, 2014, 24 (01) :175-186
[26]   Mutual Information Based Feature Selection for Fingerprint Identification [J].
Adjimi, Ahlem ;
Hacine-Gharbi, Abdenour ;
Ravier, Philippe ;
Mostefai, Messaoud .
INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2019, 43 (02) :187-198
[27]   Feature Selection Based on Mutual Information for Language Recognition [J].
Deng, Yan ;
Liu, Jia .
PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, :4319-4322
[28]   Feature selection based on mutual information with correlation coefficient [J].
Zhou, Hongfang ;
Wang, Xiqian ;
Zhu, Rourou .
APPLIED INTELLIGENCE, 2022, 52 (05) :5457-5474
[29]   Simultaneous feature selection and discretization based on mutual information [J].
Sharmin, Sadia ;
Shoyaib, Mohammad ;
Ali, Amin Ahsan ;
Khan, Muhammad Asif Hossain ;
Chae, Oksam .
PATTERN RECOGNITION, 2019, 91 :162-174
[30]   A SURVEY FOR STUDY OF FEATURE SELECTION BASED ON MUTUAL INFORMATION [J].
Su, Xiangchenyang ;
Liu, Fang .
2018 9TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2018,