Feature extraction using fuzzy maximum margin criterion

被引:21
作者
Cui, Yan [1 ,2 ]
Fan, Liya [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Technol, Nanjing 210094, Jiangsu, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng 252059, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Fuzzy maximum margin criterion; Kernel method; Fuzzy set theory; LINEAR DISCRIMINANT-ANALYSIS; EFFICIENT;
D O I
10.1016/j.neucom.2011.12.031
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In pattern recognition, feature extraction techniques are widely employed to reduce the dimensionality of date. In this paper, a novel feature extraction criterion, fuzzy maximum margin criterion (FMMC), is proposed by means of the maximum margin criterion (MMC) and fuzzy set theory. More specifically, the between-class and within-class fuzzy scatter matrices are redefined by incorporating the membership degrees of samples which relates the samples distribution information; then the feature extraction criterion maximized the average margin between classes after dimensionality reduction is applied. Furthermore, we utilize the generalized singular value decomposition (GSVD) to the criterion, which make the algorithm more effective; for nonlinear separated problems, we extend the kernel extension of FMMC with positive definite kernels. The effective of the novel criterion for linear and nonlinear separated problems is illustrated by experiments. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:52 / 58
页数:7
相关论文
共 24 条
[1]  
Alpay D., 2001, The Schur Algorithm, Reproducing Kernel Spaces and System Theory, Panoramas et Syntheses Panoramas and Syntheses
[2]  
[Anonymous], 2002, Principal components analysis
[3]  
[Anonymous], 2002, THESIS U TECHNOLOGY
[4]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[5]   A new LDA-based face recognition system which can solve the small sample size problem [J].
Chen, LF ;
Liao, HYM ;
Ko, MT ;
Lin, JC ;
Yu, GJ .
PATTERN RECOGNITION, 2000, 33 (10) :1713-1726
[6]   PENALIZED DISCRIMINANT-ANALYSIS [J].
HASTIE, T ;
BUJA, A ;
TIBSHIRANI, R .
ANNALS OF STATISTICS, 1995, 23 (01) :73-102
[7]   Generalizing discriminant analysis using the generalized singular value decomposition [J].
Howland, P ;
Park, H .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (08) :995-1006
[8]   Generalized Linear Discriminant Analysis: A Unified Framework and Efficient Model Selection [J].
Ji, Shuiwang ;
Ye, Jieping .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (10) :1768-1782
[9]   A FUZZY K-NEAREST NEIGHBOR ALGORITHM [J].
KELLER, JM ;
GRAY, MR ;
GIVENS, JA .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1985, 15 (04) :580-585
[10]   Face recognition using a fuzzy fisherface classifier [J].
Kwak, KC ;
Pedrycz, W .
PATTERN RECOGNITION, 2005, 38 (10) :1717-1732