Locality preserving difference component analysis based on the Lq norm

被引:0
作者
Liang, Zhizheng [1 ]
Chen, Xuewen [2 ]
Zhang, Lei [1 ]
Liu, Jin [1 ]
Zhou, Yong [1 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, 1 Daxue Rd, Xuzhou 221116, Jiangsu, Peoples R China
[2] Wayne State Univ, Dept Comp Sci, Detroit, MI 48202 USA
关键词
Difference component analysis; Lq norm; Convergence analysis; Dimensionality reduction; DISCRIMINANT-ANALYSIS; PCA;
D O I
10.1007/s10044-019-00834-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper develops locality preserving difference component analysis in which the intrinsic and global structure of data is exploited, and the model we propose also provides the flexibility to adapt some characteristics of data by applying the Lq norm. In order to solve the proposed model that is non-convex or non-smooth, we resort to the proximal alternating linearized optimization approach where each subproblem has good optimization properties. It is observed that the objective function in the proposed model is a semi-algebraic function. This allows us to give the convergence analysis of algorithms in terms of the Kurdyka-Lojasiewicz property. To be specific, the sequence of iterations generated by the proposed approach converges to a critical point of the objective function. The experiments on several data sets have been conducted to demonstrate the effectiveness of the proposed approach.
引用
收藏
页码:735 / 749
页数:15
相关论文
共 42 条
[1]   Convex Optimization: Algorithms and Complexity [J].
不详 .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2015, 8 (3-4) :232-+
[2]  
[Anonymous], 2006, P 23 INT C MACHINE L
[3]  
[Anonymous], IEEE T KNOWLEDGE DAT
[4]   Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality [J].
Attouch, Hedy ;
Bolte, Jerome ;
Redont, Patrick ;
Soubeyran, Antoine .
MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) :438-457
[5]  
Baccini A, 1996, ST CLASS DAT ANAL, P359
[6]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[7]   Proximal alternating linearized minimization for nonconvex and nonsmooth problems [J].
Bolte, Jerome ;
Sabach, Shoham ;
Teboulle, Marc .
MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) :459-494
[8]  
Boyd S., 2004, CONVEX OPTIMIZATION
[9]  
De la Torre F, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P362, DOI 10.1109/ICCV.2001.937541
[10]  
Frank Marguerite, 1956, NAV RES LOG, V3, P95, DOI [DOI 10.1002/NAV.3800030109, 10.1002/nav.3800030109]