A Hybrid Feature Extraction Selection Approach for High-Dimensional Non-Gaussian Data Clustering

被引:99
作者
Boutemedjet, Sabri [1 ]
Bouguila, Nizar [2 ]
Ziou, Djemel [1 ]
机构
[1] Univ Sherbrooke, Dept Informat, Sherbrooke, PQ J1K 2R1, Canada
[2] Concordia Univ, Concordia Inst Informat Engn CIISE, Montreal, PQ H3G 1T7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Unsupervised learning; mixture models; feature selection; dimensionality reduction; generalized Dirichlet mixture; EM; MML; information theory; object image categorization; STATISTICAL PATTERN-RECOGNITION; DIRICHLET MIXTURE MODEL; UNSUPERVISED SELECTION;
D O I
10.1109/TPAMI.2008.155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an unsupervised approach for feature selection and extraction in mixtures of generalized Dirichlet (GD) distributions. Our method defines a new mixture model that is able to extract independent and non-Gaussian features without loss of accuracy. The proposed model is learned using the Expectation-Maximization algorithm by minimizing the message length of the data set. Experimental results show the merits of the proposed methodology in the categorization of object images.
引用
收藏
页码:1429 / 1443
页数:15
相关论文
共 42 条
[31]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[32]   Identifying critical variables of principal components for unsupervised feature selection [J].
Mao, KZ .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (02) :339-344
[33]   A performance evaluation of local descriptors [J].
Mikolajczyk, K ;
Schmid, C .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (10) :1615-1630
[34]  
NIBLACK W, 1993, P SOC PHOTO-OPT INS, V1908, P173
[35]   Divergence based feature selection for multimodal class densities [J].
Novovicova, J ;
Pudil, P ;
Kittler, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (02) :218-223
[36]   Modeling the shape of the scene: A holistic representation of the spatial envelope [J].
Oliva, A ;
Torralba, A .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2001, 42 (03) :145-175
[37]  
Pan W, 2007, J MACH LEARN RES, V8, P1145
[38]   SMALL SAMPLE-SIZE EFFECTS IN STATISTICAL PATTERN-RECOGNITION - RECOMMENDATIONS FOR PRACTITIONERS [J].
RAUDYS, SJ ;
JAIN, AK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1991, 13 (03) :252-264
[39]  
ROBERT CP, 2002, CAHIER DUCEREMADE
[40]   Image classification for content-based indexing [J].
Vailaya, A ;
Figueiredo, MAT ;
Jain, AK ;
Zhang, HJ .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (01) :117-130