On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45
|
作者：
Balagani, Kiran S. [1 ]
Phoha, Vir V. [1 ]
机构：
[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA
来源：
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期
关键词：
Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;
D O I：
10.1109/TPAMI.2010.62
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.
引用
收藏
页码：1342 / 1343
页数：2
相关论文
共 50 条
  • [21] Feature selection based on mutual information with correlation coefficient
    Hongfang Zhou
    Xiqian Wang
    Rourou Zhu
    Applied Intelligence, 2022, 52 : 5457 - 5474
  • [22] FEATURE SELECTION BASED ON STATISTICAL ESTIMATION OF MUTUAL INFORMATION
    Kozhevin, A. A.
    SIBERIAN ELECTRONIC MATHEMATICAL REPORTS-SIBIRSKIE ELEKTRONNYE MATEMATICHESKIE IZVESTIYA, 2021, 18 : 720 - 728
  • [23] A Filter Feature Selection Algorithm Based on Mutual Information for Intrusion Detection
    Zhao, Fei
    Zhao, Jiyong
    Niu, Xinxin
    Luo, Shoushan
    Xin, Yang
    APPLIED SCIENCES-BASEL, 2018, 8 (09):
  • [24] Email Filtering based on Supervised Learning and Mutual Information Feature Selection
    Gad, Walaa
    Rady, Sherine
    2015 TENTH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2015, : 147 - 152
  • [25] A Fuzzy Mutual Information-based Feature Selection Method for Classification
    Hogue, N.
    Ahmed, H. A.
    Bhattacharyya, D. K.
    Kalita, J. K.
    FUZZY INFORMATION AND ENGINEERING, 2016, 8 (03) : 355 - 384
  • [26] Mutual information-based feature selection for radiomics
    Oubel, Estanislao
    Beaumont, Hubert
    Iannessi, Antoine
    MEDICAL IMAGING 2016: PACS AND IMAGING INFORMATICS: NEXT GENERATION AND INNOVATIONS, 2016, 9789
  • [27] Feature Selection Based on Mutual Information for Language Recognition
    Deng, Yan
    Liu, Jia
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 4319 - 4322
  • [28] Granular multi-label feature selection based on mutual information
    Li, Feng
    Miao, Duoqian
    Pedrycz, Witold
    PATTERN RECOGNITION, 2017, 67 : 410 - 423
  • [29] Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion
    Long Zhang
    Linlin Shan
    Jianhua Wang
    Neural Computing and Applications, 2017, 28 : 2795 - 2808
  • [30] A filter approach to feature selection based on mutual information
    Huang, Jinjie
    Cai, Yunze
    Xu, Xiaoming
    PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, VOLS 1 AND 2, 2006, : 84 - 89
12345