Feature selection based on fuzzy joint mutual information maximization

被引:6
作者
Salem, Omar A. M. [1 ,2 ]
Liu, Feng [1 ]
Sherif, Ahmed Sobhy [2 ]
Zhang, Wen [3 ]
Chen, Xi [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Suez Canal Univ, Fac Comp & Informat, Ismailia 41522, Egypt
[3] Huazhong Agr Univ, Coll Informat, Wuhan 430070, Peoples R China
关键词
mutual information; fuzzy sets; fuzzy mutual information; feature selection; classification systems; MAX-RELEVANCE; UNCERTAINTY;
D O I
10.3934/mbe.2021016
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Nowadays, real-world applications handle a huge amount of data, especially with high dimension features space. These datasets are a significant challenge for classification systems. Unfortunately, most of the features present are irrelevant or redundant, thus making these systems inefficient and inaccurate. For this reason, many feature selection (FS) methods based on information theory have been introduced to improve the classification performance. However, the current methods have some limitations such as dealing with continuous features, estimating the redundancy.relations, and considering the outer-class information. To overcome these limitations, this paper presents a. new FS method, called Fuzzy Joint Mutual Information Maximization (EIMIM). The effectiveness of our proposed method is verified by conducting an experimental comparison with nine conventional and state-of-the-art feature selection methods. Based on 13 benchmark datascts, experimental results confirm that our proposed method leads to promising improvement in classification performance and feature selection stability.
引用
收藏
页码:305 / 327
页数:23
相关论文
共 50 条
[41]   Feature Selection for Bearing Fault Detection Based on Mutual Information [J].
Kappaganthu, Karthik ;
Nataraj, C. ;
Samanta, Biswanath .
IUTAM SYMPOSIUM ON EMERGING TRENDS IN ROTOR DYNAMICS, 2011, 25 :523-533
[42]   Fuzzy Mutual Information Based min-Redundancy and Max-Relevance Heterogeneous Feature Selection [J].
Yu D. ;
An S. ;
Hu Q. .
International Journal of Computational Intelligence Systems, 2011, 4 (4) :619-633
[43]   Textural feature selection by joint mutual information based on Gaussian mixture model for multispectral image classification [J].
Kerroum, Mounir Ait ;
Hammouch, Ahmed ;
Aboutajdine, Driss .
PATTERN RECOGNITION LETTERS, 2010, 31 (10) :1168-1174
[44]   A novel feature selection method based on normalized mutual information [J].
La The Vinh ;
Lee, Sungyoung ;
Park, Young-Tack ;
d'Auriol, Brian J. .
APPLIED INTELLIGENCE, 2012, 37 (01) :100-120
[45]   Mutual Information Based on Renyi's Entropy Feature Selection [J].
Liu Can-Tao ;
Hu Bao-Gang .
2009 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INTELLIGENT SYSTEMS, PROCEEDINGS, VOL 1, 2009, :816-820
[46]   Effective Global Approaches for Mutual Information Based Feature Selection [J].
Nguyen, Xuan Vinh ;
Chan, Jeffrey ;
Romano, Simone ;
Bailey, James .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :512-521
[47]   Mutual Information Based Feature Selection for Stereo Visual Odometry [J].
Kottath, Rahul ;
Poddar, Shashi ;
Sardana, Raghav ;
Bhondekar, Amol P. ;
Karar, Vinod .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 100 (3-4) :1559-1568
[48]   Theoretical evaluation of feature selection methods based on mutual information [J].
Pascoal, Claudia ;
Oliveira, M. Rosario ;
Pacheco, Antonio ;
Valadas, Rui .
NEUROCOMPUTING, 2017, 226 :168-181
[49]   Mutual Information Based Feature Selection for Medical Image Retrieval [J].
Zhi, Lijia ;
Zhang, Shaomin ;
Li, Yan .
NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
[50]   Mutual information-based feature selection for multilabel classification [J].
Doquire, Gauthier ;
Verleysen, Michel .
NEUROCOMPUTING, 2013, 122 :148-155