Fast orthogonal forward selection algorithm for feature subset selection

被引:70
作者
Mao, KZ [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 05期
关键词
feature selection; forward selection; orthogonal decomposition;
D O I
10.1109/TNN.2002.1031954
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection is an important issue in pattern classification. In the present study, we develop a fast orthogonal forward selection (FOFS) algorithm for feature subset selection. The FOFS algorithm employs orthogonal transform to decompose correlations among candidate features, but it performs the orthogonal decomposition in an implicit way. Consequently, the fast algorithm demands less computational efforts as compared with the conventional orthogonal forward selection (OFS).
引用
收藏
页码:1218 / 1224
页数:7
相关论文
共 13 条
[1]   Iterative fast orthogonal search algorithm for MDL-based training of generalized single-layer networks [J].
Adeney, KM ;
Korenberg, MJ .
NEURAL NETWORKS, 2000, 13 (07) :787-799
[2]  
Blake C.L., 1998, UCI repository of machine learning databases
[3]   FAST ORTHOGONAL LEAST-SQUARES ALGORITHM FOR EFFICIENT SUBSET MODEL SELECTION [J].
CHEN, S ;
WIGGER, J .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1995, 43 (07) :1713-1715
[4]   Wrappers for feature subset selection [J].
Kohavi, R ;
John, GH .
ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) :273-324
[5]  
Korenberg M. J., 1987, Proceedings of the 28th Midwest Symposium on Circuits and Systems, V1, P270
[6]   Orthogonal approaches to time-series analysis and system identification [J].
Korenberg, Michael J. ;
Paarmann, Larry D. .
IEEE SIGNAL PROCESSING MAGAZINE, 1991, 8 (03) :29-43
[7]   A ROBUST ORTHOGONAL ALGORITHM FOR SYSTEM-IDENTIFICATION AND TIME-SERIES ANALYSIS [J].
KORENBERG, MJ .
BIOLOGICAL CYBERNETICS, 1989, 60 (04) :267-276
[8]   IDENTIFYING NONLINEAR DIFFERENCE EQUATION AND FUNCTIONAL EXPANSION REPRESENTATIONS - THE FAST ORTHOGONAL ALGORITHM [J].
KORENBERG, MJ .
ANNALS OF BIOMEDICAL ENGINEERING, 1988, 16 (01) :123-142
[9]  
KORENBERG MJ, 1985, P 28 MIDW S CIRC SYS, V1, P96
[10]  
NARENDRA P, 1977, IEEE T COMPUT, V26, P917, DOI 10.1109/TC.1977.1674939