On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45

作者：

Balagani, Kiran S. ^{[1
]}

Phoha, Vir V. ^{[1
]}

机构：

[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA

来源：

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期

关键词：

Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;

D O I：

10.1109/TPAMI.2010.62

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.

引用

页码：1342 / 1343

页数：2

共 50 条

[31] Simultaneous feature selection and discretization based on mutual information
Sharmin, Sadia
Shoyaib, Mohammad
Ali, Amin Ahsan
Khan, Muhammad Asif Hossain
Chae, Oksam
PATTERN RECOGNITION, 2019, 91 : 162 - 174
[32] Feature selection based on mutual information with correlation coefficient
Zhou, Hongfang
Wang, Xiqian
Zhu, Rourou
APPLIED INTELLIGENCE, 2022, 52 (05) : 5457 - 5474
[33] A review of feature selection methods based on mutual information
Jorge R. Vergara
Pablo A. Estévez
Neural Computing and Applications, 2014, 24 : 175 - 186
[34] Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization
Wang, Xinzheng
Guo, Bing
Shen, Yan
Zhou, Chimin
Duan, Xuliang
IEEE ACCESS, 2019, 7 : 151525 - 151538
[35] On Estimating Mutual Information for Feature Selection
Schaffernicht, Erik
Kaltenhaeuser, Robert
Verma, Saurabh Shekhar
Gross, Horst-Michael
ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 362 - +
[36] Fast binary feature selection with conditional mutual information
Fleuret, F
JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 1531 - 1555
[37] A Novel Unsupervised Approach to Heterogeneous Feature Selection Based on Fuzzy Mutual Information
Yuan, Zhong
Chen, Hongmei
Zhang, Pengfei
Wan, Jihong
Li, Tianrui
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2022, 30 (09) : 3395 - 3409
[38] Feature selection using mutual information based uncertainty measures for tumor classification
Sun, Lin
Xu, Jiucheng
BIO-MEDICAL MATERIALS AND ENGINEERING, 2014, 24 (01) : 763 - 770
[39] An Overview of Methods for Feature Selection Based on Mutual Information for Stream Data Classification
Wankhade, Kapil
Rane, Dhiraj
Thool, Ravindra
2013 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT 2013), 2013, : 630 - 634
[40] Feature selection using Joint Mutual Information Maximisation
Bennasar, Mohamed
Hicks, Yulia
Setchi, Rossitza
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (22) : 8520 - 8532

← 1 2 3 4 5 →