C2DNDA: A Deep Framework for Nonlinear Dimensionality Reduction

被引:10
作者
Wang, Qi [1 ,2 ]
Qin, Zequn [1 ,2 ]
Nie, Feiping [1 ,2 ]
Li, Xuelong [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Classification; convolutional neural networks (CNNs); dimensionality reduction; two-dimensional linear discriminant analysis (2DLDA); LINEAR DISCRIMINANT-ANALYSIS; RECOGNITION; 2D-LDA;
D O I
10.1109/TIE.2020.2969072
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dimensionality reduction has attracted much research interest in the past few decades. Existing dimensionality reduction methods like linear discriminant analysis and principal component analysis have achieved promising performance, but the single and linear projection properties limit further improvements of performance. A novel convolutional two-dimensional nonlinear discriminant analysis method is proposed for dimensionality reduction in this article. In order to handle nonlinear data properly, we present a newly designed structure with convolutional neural networks (CNNs) to realize an equivalent objective function with classical two-dimensional linear discriminant analysis (2DLDA) and thus embed the original 2DLDA into an end-to-end network. In this way, the proposed dimensionality reduction network can utilize the nonlinearity of the CNN and benefit from the learning ability. The results of experiment on different image-related applications demonstrate that our method outperforms other comparable approaches, and its effectiveness is proved.
引用
收藏
页码:1684 / 1694
页数:11
相关论文
共 44 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
Andrew G., 2013, PMLR, P1247
[3]  
[Anonymous], 2014, ARXIV14096070
[4]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[5]   Orthogonal laplacianfaces for face recognition [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Zhang, Hong-Jiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (11) :3608-3614
[6]   PCANet: A Simple Deep Learning Baseline for Image Classification? [J].
Chan, Tsung-Han ;
Jia, Kui ;
Gao, Shenghua ;
Lu, Jiwen ;
Zeng, Zinan ;
Ma, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5017-5032
[7]   Compound Rank-k Projections for Bilinear Analysis [J].
Chang, Xiaojun ;
Nie, Feiping ;
Wang, Sen ;
Yang, Yi ;
Zhou, Xiaofang ;
Zhang, Chengqi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (07) :1502-1513
[8]   ICDAR2013 Competition on Handwritten Digit Recognition (HDRC 2013) [J].
Diem, Markus ;
Fiel, Stefan ;
Garz, Angelika ;
Keglevic, Manuel ;
Kleber, Florian ;
Sablatnig, Robert .
2013 12TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), 2013, :1422-1427
[9]  
Dorfer M., 2016, P INT C LEARN REPR
[10]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448