A filter approach to feature selection based on mutual information

被引：0

作者：

Huang, Jinjie ^{[1
]}

Cai, Yunze ^{[1
]}

Xu, Xiaoming ^{[1
]}

机构：

[1] Shanghai Jiao Tong Univ, Dept Automat, Dongchuan Rd 800, Shanghai 200240, Peoples R China

来源：

PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, VOLS 1 AND 2 | 2006年

基金：

黑龙江省自然科学基金; 中国国家自然科学基金; 中国博士后科学基金;

关键词：

pattern classification; machine learning; feature selection; filter approach; mutual information;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In pattern recognition, feature selection aims to choose the smallest subset of features that is necessary and sufficient to describe the target concept. In this paper, a mutual information-based constructive criterion under arbitrary information distributions of input features is presented for feature selection. This criterion can capture both the relevance to the output classes and the redundancy with respect to the already,-selected features without any parameters like 8 in MIFS or MIFS-U methods to be preset. Furthermore, a modified greedy feature selection algorithm called MICC is proposed, and experimental results demonstrate the good performance of MICC on both synthetic and benchmark data sets.

引用

页码：84 / 89

页数：6

共 50 条

[21] On Estimating Mutual Information for Feature Selection [J].

Schaffernicht, Erik ;

Kaltenhaeuser, Robert ;

Verma, Saurabh Shekhar ;

Gross, Horst-Michael .

ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 :362-+

[22] Feature Selection and Discretization based on Mutual Information [J].

Sharmin, Sadia ;

Ali, Amin Ahsan ;

Khan, Muhammad Asif Hossain ;

Shoyaib, Mohammad .

2017 IEEE INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2017,

[23] Using Mutual Information for Feature Selection in Programmatic Advertising [J].

Ciesielczyk, Michal .

2017 IEEE INTERNATIONAL CONFERENCE ON INNOVATIONS IN INTELLIGENT SYSTEMS AND APPLICATIONS (INISTA), 2017, :290-295

[24] Embedded-filter ACO using clustering based mutual information for feature selection [J].

Mallidi, S. Kumar Reddy ;

Ramisetty, Rajeswara Rao .

JOURNAL OF COMBINATORIAL OPTIMIZATION, 2025, 49 (02)

[25] Mutual Information Estimation for Filter Based Feature Selection Using Particle Swarm Optimization [J].

Hoai Bach Nguyen ;

Xue, Bing ;

Andreae, Peter .

APPLICATIONS OF EVOLUTIONARY COMPUTATION, EVOAPPLICATIONS 2016, PT I, 2016, 9597 :719-736

[26] Feature Selection for Bearing Fault Detection Based on Mutual Information [J].

Kappaganthu, Karthik ;

Nataraj, C. ;

Samanta, Biswanath .

IUTAM SYMPOSIUM ON EMERGING TRENDS IN ROTOR DYNAMICS, 2011, 25 :523-533

[27] Fuzzy Mutual Information Feature Selection Based on Representative Samples [J].

Salem, Omar A. M. ;

Wang, Liwei .

INTERNATIONAL JOURNAL OF SOFTWARE INNOVATION, 2018, 6 (01) :58-72

[28] A novel feature selection method based on normalized mutual information [J].

La The Vinh ;

Sungyoung Lee ;

Young-Tack Park ;

Brian J. d’Auriol .

Applied Intelligence, 2012, 37 :100-120

[29] Conditional mutual information based feature selection for classification task [J].

Novovicova, Jana ;

Somol, Petr ;

Haindl, Michal ;

Pudil, Pavel .

PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS AND APPLICATIONS, PROCEEDINGS, 2007, 4756 :417-426

[30] A Hybrid Feature Selection Approach for Parkinson’s Detection Based on Mutual Information Gain and Recursive Feature Elimination [J].

Rohit Lamba ;

Tarun Gulati ;

Anurag Jain .

Arabian Journal for Science and Engineering, 2022, 47 :10263-10276

← 1 2 3 4 5 →