Linear feature selection in texture analysis - A PLS based method

被引:2
作者
Marques, Joselene [1 ]
Igel, Christian [1 ]
Lillholm, Martin [2 ]
Dam, Erik B. [2 ]
机构
[1] Univ Copenhagen, Dept Comp Sci, DK-2100 Copenhagen, Denmark
[2] Biomediq, DK-2100 Copenhagen, Denmark
关键词
Texture analysis; Machine learning; Partial least squares; Classification; Feature extraction; Feature selection; PARTIAL LEAST-SQUARES; VARIABLE SELECTION; MRI; CLASSIFICATION; REGRESSION; TOOL; AGE;
D O I
10.1007/s00138-012-0461-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a texture analysis methodology that combined uncommitted machine-learning techniques and partial least square (PLS) in a fully automatic framework. Our approach introduces a robust PLS-based dimensionality reduction (DR) step to specifically address outliers and high-dimensional feature sets. The texture analysis framework was applied to diagnosis of knee osteoarthritis (OA). To classify between healthy subjects and OA patients, a generic bank of texture features was extracted from magnetic resonance images of tibial knee bone. The features were used as input to the DR algorithm, which first applied a PLS regression to rank the features and then defined the best number of features to retain in the model by an iterative learning phase. The outliers in the dataset, that could inflate the number of selected features, were eliminated by a pre-processing step. To cope with the limited number of samples, the data were evaluated using Monte Carlo cross validation (CV). The developed DR method demonstrated consistency in selecting a relatively homogeneous set of features across the CV iterations. Per each CV group, a median of 19 % of the original features was selected and considering all CV groups, the methods selected 36 % of the original features available. The diagnosis evaluation reached a generalization area-under-the-ROC curve of 0.92, which was higher than established cartilage-based markers known to relate to OA diagnosis.
引用
收藏
页码:1435 / 1444
页数:10
相关论文
共 41 条
[1]   Variable selection in discriminant partial least-squares analysis [J].
Alsberg, BK ;
Kell, DB ;
Goodacre, R .
ANALYTICAL CHEMISTRY, 1998, 70 (19) :4126-4133
[2]  
[Anonymous], 2003, Encyclopedia for Research Methods for the Social Sciences
[3]  
[Anonymous], 1988, Principles of Multivariate Analysis
[4]  
[Anonymous], 1998, FEATURE EXTRACTION C
[5]  
[Anonymous], 1998, HDB PATTERN RECOGNIT
[6]   Partial least squares for discrimination [J].
Barker, M ;
Rayens, W .
JOURNAL OF CHEMOMETRICS, 2003, 17 (03) :166-173
[7]  
Beyer K, 1999, LECT NOTES COMPUT SC, V1540, P217
[8]   MetaFIND: A feature analysis tool for metabolomics data [J].
Bryan, Kenneth ;
Brennan, Lorraine ;
Cunningham, Padraig .
BMC BIOINFORMATICS, 2008, 9 (1)
[9]  
BURMAN P, 1989, BIOMETRIKA, V76, P503, DOI 10.2307/2336116
[10]   Performance of some variable selection methods when multicollinearity is present [J].
Chong, IG ;
Jun, CH .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2005, 78 (1-2) :103-112