C2DNDA: A Deep Framework for Nonlinear Dimensionality Reduction

被引:8
作者
Wang, Qi [1 ,2 ]
Qin, Zequn [1 ,2 ]
Nie, Feiping [1 ,2 ]
Li, Xuelong [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Classification; convolutional neural networks (CNNs); dimensionality reduction; two-dimensional linear discriminant analysis (2DLDA); LINEAR DISCRIMINANT-ANALYSIS; RECOGNITION; 2D-LDA;
D O I
10.1109/TIE.2020.2969072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dimensionality reduction has attracted much research interest in the past few decades. Existing dimensionality reduction methods like linear discriminant analysis and principal component analysis have achieved promising performance, but the single and linear projection properties limit further improvements of performance. A novel convolutional two-dimensional nonlinear discriminant analysis method is proposed for dimensionality reduction in this article. In order to handle nonlinear data properly, we present a newly designed structure with convolutional neural networks (CNNs) to realize an equivalent objective function with classical two-dimensional linear discriminant analysis (2DLDA) and thus embed the original 2DLDA into an end-to-end network. In this way, the proposed dimensionality reduction network can utilize the nonlinearity of the CNN and benefit from the learning ability. The results of experiment on different image-related applications demonstrate that our method outperforms other comparable approaches, and its effectiveness is proved.
引用
收藏
页码:1684 / 1694
页数:11
相关论文
共 44 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Andrew G, 2013, P 30 INT C MACHINE L, ppp1247
  • [3] [Anonymous], 1999, CITESEER
  • [4] Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection
    Belhumeur, PN
    Hespanha, JP
    Kriegman, DJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) : 711 - 720
  • [5] Orthogonal laplacianfaces for face recognition
    Cai, Deng
    He, Xiaofei
    Han, Jiawei
    Zhang, Hong-Jiang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (11) : 3608 - 3614
  • [6] PCANet: A Simple Deep Learning Baseline for Image Classification?
    Chan, Tsung-Han
    Jia, Kui
    Gao, Shenghua
    Lu, Jiwen
    Zeng, Zinan
    Ma, Yi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5017 - 5032
  • [7] Compound Rank-k Projections for Bilinear Analysis
    Chang, Xiaojun
    Nie, Feiping
    Wang, Sen
    Yang, Yi
    Zhou, Xiaofang
    Zhang, Chengqi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (07) : 1502 - 1513
  • [8] ICDAR2013 Competition on Handwritten Digit Recognition (HDRC 2013)
    Diem, Markus
    Fiel, Stefan
    Garz, Angelika
    Keglevic, Manuel
    Kleber, Florian
    Sablatnig, Robert
    [J]. 2013 12TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), 2013, : 1422 - 1427
  • [9] Dorfer M., 2016, P INT C LEARN REPR
  • [10] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448