Multi-task least squares twin support vector machine for classification

被引:51
作者
Mei, Benshan [1 ]
Xu, Yitian [2 ]
机构
[1] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[2] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Pattern recognition; Multi-task learning; Relation learning; Least square twin support vector machine; MODEL;
D O I
10.1016/j.neucom.2018.12.079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the bloom of machine learning, pattern recognition plays an important role in many aspects. However, traditional pattern recognition mainly focuses on single task learning (STL), and the multi-task learning (MTL) has largely been ignored. Compared to STL, MTL can improve the performance of learning methods through the shared information among all tasks. Inspired by the recently proposed directed multi-task twin support vector machine (DMTSVM) and the least squares twin support vector machine (LSTWSVM), we put forward a novel multi-task least squares twin support vector machine (MTLS-TWSVM). Instead of two dual quadratic programming problems (QPPs) solved in DMTSVM, our algorithm only needs to deal with two smaller linear equations. This leads to simple solutions, and the calculation can be effectively accelerated. Thus, our proposed model can be applied to the large scale datasets. In addition, it can deal with linear inseparable samples by using kernel trick. Experiments on three popular multi-task datasets show the effectiveness of our proposed methods. Finally, we apply it to two popular image datasets, and the experimental results also demonstrate the validity of our proposed algorithm. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:26 / 33
页数:8
相关论文
共 53 条
[1]   Convex multi-task feature learning [J].
Argyriou, Andreas ;
Evgeniou, Theodoros ;
Pontil, Massimiliano .
MACHINE LEARNING, 2008, 73 (03) :243-272
[2]   Task clustering and gating for Bayesian multitask learning [J].
Bakker, B ;
Heskes, T .
JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 4 (01) :83-99
[3]  
Baytas IM, 2016, IEEE DATA MINING, P11, DOI [10.1109/ICDM.2016.61, 10.1109/ICDM.2016.0012]
[4]   A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[5]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[6]   Boosted multi-task learning [J].
Chapelle, Olivier ;
Shivaswamy, Pannagadatta ;
Vadrevu, Srinivas ;
Weinberger, Kilian ;
Zhang, Ya ;
Tseng, Belle .
MACHINE LEARNING, 2011, 85 (1-2) :149-173
[7]   Learning Incoherent Sparse and Low-Rank Patterns from Multiple Tasks [J].
Chen, Jianhui ;
Liu, Ji ;
Ye, Jieping .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2012, 5 (04)
[8]  
Evgeniou T., 2004, P 10 ACM SIGKDD INT
[9]  
Fiebig KH, 2016, IEEE SYS MAN CYBERN, P2307, DOI 10.1109/SMC.2016.7844582
[10]  
Fung G., 2001, KDD-2001. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, P77, DOI 10.1145/502512.502527