Robust ordinal regression induced by lp -centroid

被引:4
作者
Tian, Qing [1 ,2 ,3 ]
Zhang, Wenqiang [1 ,2 ]
Wang, Liping [4 ]
Chen, Songcan [5 ]
Yin, Hujun [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equip, Nanjing 210044, Jiangsu, Peoples R China
[3] Univ Manchester, Sch Elect & Elect Engn, Manchester M13 9PL, Lancs, England
[4] Nanjing Univ Aeronaut & Astronaut, Dept Math, Nanjing 210016, Jiangsu, Peoples R China
[5] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Ordinal regression (OR); Class-center-induced threshold OR; l(p)-centroid; Discriminant learning; Manifold learning; HUMAN AGE ESTIMATION; ALGORITHM; STRATEGIES; RANKING;
D O I
10.1016/j.neucom.2018.06.041
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ordinal regression (OR) is an important research topic in machine learning and has attracted extensive attention due to its wide applications. So far, a variety of methods have been proposed to perform OR, in which the class-center-induced threshold methods (like KDLOR and MOR) have received more attention, for their simplicity and promising performance. The class-center-induced ORs typically calculate the ordinal thresholds with class centers, which are typically derived from the l(2) -norm. Unfortunately, in such a way, the class means may be biased when the data is corrupted with outliers (i.e., non-i.i.d. noises) such that the resulting OR accuracy will be deteriorated. Motivated by the success of l(p)-norm in applications against noises, in this paper we propose a novel type of class centroid derived from the l(p)-norm (coined as l(p)-centroid) to overcome the drawbacks above, and provide an optimization algorithm and corresponding convergence analysis for computing the l(p)-centroid. To evaluate the effectiveness of l(p)-centroid in OR context against noises, we then combine the l(p)-centroid with two representative class-center-induced ORs, namely discriminant learning based and manifold learning based ORs. Finally, extensive OR experiments on synthetic and real-world datasets demonstrate the effectiveness and superiority of the proposed methods to related existing methods. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:184 / 195
页数:12
相关论文
共 46 条
[1]   Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions [J].
Adomavicius, G ;
Tuzhilin, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (06) :734-749
[2]  
[Anonymous], 2001, P ACM INT MULT C EXH, DOI DOI 10.1145/500141.500159
[3]  
[Anonymous], 2001, EUROPEAN C MACHINE L, DOI DOI 10.1007/3-540-44795-413
[4]  
[Anonymous], 2016, IEEE T CYBERN
[5]  
Belkin M, 2002, ADV NEUR IN, V14, P585
[6]  
Cardoso JS, 2007, J MACH LEARN RES, V8, P1393
[7]   Ordinal Data Classification Using Kernel Discriminant Analysis: A Comparison of Three Approaches [J].
Cardoso, Jaime S. ;
Sousa, Ricardo ;
Domingues, Ines .
2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, :473-477
[8]   Non-Local Euclidean Medians [J].
Chaudhury, Kunal N. ;
Singer, Amit .
IEEE SIGNAL PROCESSING LETTERS, 2012, 19 (11) :745-748
[9]   Face Recognition and Retrieval Using Cross-Age Reference Coding With Cross-Age Celebrity Dataset [J].
Chen, Bor-Chun ;
Chen, Chu-Song ;
Hsu, Winston H. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (06) :804-815
[10]   A Neural Network Approach to Ordinal Regression [J].
Cheng, Jianlin ;
Wang, Zheng ;
Pollastri, Gianluca .
2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, :1279-1284