Kernel Reverse Neighborhood Discriminant Analysis

被引:1
|
作者
Li, Wangwang [1 ]
Tan, Hengliang [1 ]
Feng, Jianwei [1 ]
Xie, Ming [1 ]
Du, Jiao [1 ]
Yang, Shuo [1 ]
Yan, Guofeng [1 ]
机构
[1] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
linear discriminant analysis; kernel trick; reverse nearest neighbors; Gaussian kernel; LDA; EXTRACTION;
D O I
10.3390/electronics12061322
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, neighborhood linear discriminant analysis (nLDA) exploits reverse nearest neighbors (RNN) to avoid the assumption of linear discriminant analysis (LDA) that all samples from the same class should be independently and identically distributed (i.i.d.). nLDA performs well when a dataset contains multimodal classes. However, in complex pattern recognition tasks, such as visual classification, the complex appearance variations caused by deformation, illumination and visual angle often generate non-linearity. Furthermore, it is not easy to separate the multimodal classes in lower-dimensional feature space. One solution to these problems is to map the feature to a higher-dimensional feature space for discriminant learning. Hence, in this paper, we employ kernel functions to map the original data to a higher-dimensional feature space, where the nonlinear multimodal classes can be better classified. We give the details of the deduction of the proposed kernel reverse neighborhood discriminant analysis (KRNDA) with the kernel tricks. The proposed KRNDA outperforms the original nLDA on most datasets of the UCI benchmark database. In high-dimensional visual recognition tasks of handwritten digit recognition, object categorization and face recognition, our KRNDA achieves the best recognition results compared to several sophisticated LDA-based discriminators.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Direct kernel neighborhood discriminant analysis for face recognition
    Hu, Haifeng
    Zhang, Ping
    Ma, Zhengming
    PATTERN RECOGNITION LETTERS, 2009, 30 (10) : 902 - 907
  • [2] Neighborhood linear discriminant analysis
    Zhu, Fa
    Gao, Junbin
    Yang, Jian
    Ye, Ning
    PATTERN RECOGNITION, 2022, 123
  • [3] Kernel discriminant analysis for regression problems
    Kwak, Nojun
    PATTERN RECOGNITION, 2012, 45 (05) : 2019 - 2031
  • [4] The Geometry of Nonlinear Embeddings in Kernel Discriminant Analysis
    Kim, Jiae
    Lee, Yoonkyung
    Liang, Zhiyu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 5203 - 5217
  • [5] Lithology identification using kernel Fisher discriminant analysis with well logs
    Dong, Shaoqun
    Wang, Zhizhang
    Zeng, Lianbo
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2016, 143 : 95 - 102
  • [6] Kernel Optimization in Discriminant Analysis
    You, Di
    Hamsici, Onur C.
    Martinez, Aleix M.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) : 631 - 638
  • [7] A reformative kernel Fisher discriminant analysis
    Xu, Y
    Yang, JY
    Yang, J
    PATTERN RECOGNITION, 2004, 37 (06) : 1299 - 1302
  • [8] Bayes Optimal Kernel Discriminant Analysis
    You, Di
    Martinez, Aleix M.
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 3533 - 3538
  • [9] Sparse multinomial kernel discriminant analysis (sMKDA)
    Harrison, Robert F.
    Pasupa, Kitsuchart
    PATTERN RECOGNITION, 2009, 42 (09) : 1795 - 1802
  • [10] Face Recognition Using Kernel Discriminant Analysis
    张燕昆
    High Technology Letters, 2002, (04) : 43 - 46