C2DNDA: A Deep Framework for Nonlinear Dimensionality Reduction

被引:8
作者
Wang, Qi [1 ,2 ]
Qin, Zequn [1 ,2 ]
Nie, Feiping [1 ,2 ]
Li, Xuelong [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Classification; convolutional neural networks (CNNs); dimensionality reduction; two-dimensional linear discriminant analysis (2DLDA); LINEAR DISCRIMINANT-ANALYSIS; RECOGNITION; 2D-LDA;
D O I
10.1109/TIE.2020.2969072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dimensionality reduction has attracted much research interest in the past few decades. Existing dimensionality reduction methods like linear discriminant analysis and principal component analysis have achieved promising performance, but the single and linear projection properties limit further improvements of performance. A novel convolutional two-dimensional nonlinear discriminant analysis method is proposed for dimensionality reduction in this article. In order to handle nonlinear data properly, we present a newly designed structure with convolutional neural networks (CNNs) to realize an equivalent objective function with classical two-dimensional linear discriminant analysis (2DLDA) and thus embed the original 2DLDA into an end-to-end network. In this way, the proposed dimensionality reduction network can utilize the nonlinearity of the CNN and benefit from the learning ability. The results of experiment on different image-related applications demonstrate that our method outperforms other comparable approaches, and its effectiveness is proved.
引用
收藏
页码:1684 / 1694
页数:11
相关论文
共 44 条
  • [11] Region-Based Convolutional Networks for Accurate Object Detection and Segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (01) : 142 - 158
  • [12] Goodfellow I., 2013, International conference on machine learning, P1319
  • [13] Graham B., 2014, ARXIV14096070
  • [14] Han B, 2018, ADV NEUR IN, V31
  • [15] He X., 2005, Advances in neural information processing systems, P499, DOI DOI 10.5555/2976248
  • [16] Hinton GE, 2012, RESEARCHGATE, DOI [DOI 10.48550/ARXIV.1207.0580, 10.48550/arXiv.1207.0580]
  • [17] Complexity-Reduced Scheme for Feature Extraction With Linear Discriminant Analysis
    Hou, Yuxi
    Song, Iickho
    Min, Hwang-Ki
    Park, Cheol Hoon
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (06) : 1003 - 1009
  • [18] Inoue K, 2006, INT C PATT RECOG, P540
  • [19] Ioffe S., 2015, PMLR, V37, P448
  • [20] Kim Y., 2014, ARXIV14085882, P1, DOI [10.3115/v1/D14-1181, DOI 10.3115/V1/D14-1181]