On the Feature Selection Criterion Based on an Approximation of Multidimensional Mutual Information

被引：45

作者：

Balagani, Kiran S. ^{[1
]}

Phoha, Vir V. ^{[1
]}

机构：

[1] Louisiana Tech Univ, Ctr Secure Cyberspace, Ruston, LA 71272 USA

来源：

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | 2010年 / 32卷 / 07期

关键词：

Feature selection; entropy; mutual information; Bayes classification error; entropy estimation; CLASSIFICATION;

D O I：

10.1109/TPAMI.2010.62

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We derive the feature selection criterion presented in [1] and [2] from the multidimensional mutual information between features and the class. Our derivation: 1) specifies and validates the lower-order dependency assumptions of the criterion and 2) mathematically justifies the utility of the criterion by relating it to Bayes classification error.

引用

页码：1342 / 1343

页数：2

共 12 条

[1] USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING [J].

BATTITI, R .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :537-550

[2]

Beirlant J, 1997, International Journal of Mathematical and Statistical Sciences, V6, P17

[3] Feature selection, mutual information, and the classification of high-dimensional patterns [J].

Bonev, Boyan ;

Escolano, Francisco ;

Cazorla, Miguel .

PATTERN ANALYSIS AND APPLICATIONS, 2008, 11 (3-4) :309-319

[4]

Cover T., 2004, ELEMENTS INFORM THEO

[5] PROBABILITY OF ERROR, EQUIVOCATION, AND CHERNOFF BOUND [J].

HELLMAN, ME ;

RAVIV, J .

IEEE TRANSACTIONS ON INFORMATION THEORY, 1970, 16 (04) :368-+

[6] Applications of entropic spanning graphs [J].

Hero, AO ;

Ma, B ;

Michel, OJJ ;

Gorman, J .

IEEE SIGNAL PROCESSING MAGAZINE, 2002, 19 (05) :85-95

[7] Input feature selection by mutual information based on Parzen window [J].

Kwak, N ;

Choi, CH .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (12) :1667-1671

[8] Input feature selection for classification problems [J].

Kwak, N ;

Choi, CH .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (01) :143-159

[9] CHARACTERISTIC SELECTION PROBLEM IN RECOGNITION SYSTEMS [J].

LEWIS, PM .

IRE TRANSACTIONS ON INFORMATION THEORY, 1962, 8 (02) :171-&

[10] Image matching using alpha-entropy measures and entropic graphs [J].

Neemuchwala, H ;

Hero, A ;

Carson, P .

SIGNAL PROCESSING, 2005, 85 (02) :277-296

← 1 2 →