Support vector machine active learning by Hessian regularization

被引:14
作者
Liu, Weifeng [1 ]
Zhang, Lianbo [1 ,2 ]
Tao, Dapeng [3 ]
Cheng, Jun [4 ,5 ]
机构
[1] China Univ Petr East China, Coll Informat & Control Engn, Qingdao 266580, Peoples R China
[2] Univ Technol Sydney, Adv Analyt Inst, Sydney, NSW 2007, Australia
[3] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Yunnan, Peoples R China
[4] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[5] Chinese Univ Hong Kong, Shatin, Hong Kong, Peoples R China
关键词
Active learning; Semi-supervised; Manifold regularization; Image segmentation; Activity recognition; Hessian; NONLINEAR DIMENSIONALITY REDUCTION; IMAGE; EIGENMAPS;
D O I
10.1016/j.jvcir.2017.08.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is time-consuming and expensive to gather and label the growing multimedia data that is easily accessible with the prodigious development of Internet technology and digital sensors. Hence, it is essential to develop a technique that can efficiently be utilized for the large-scale multimedia data especially when labeled data is rare. Active learning is showing to be one useful approach that greedily chooses queries from unlabeled data to be labeled for further learning and then minimizes the estimated expected learning error. However, most active learning methods only take into account the labeled data in the training of the classifier. In this paper, we introduce a semi-supervised algorithm to learn the classifier and then perform active learning scheme on top of the semi-supervised scheme. Particularly, we employ Hessian regularization into support vector machine to boost the classifier. Hessian regularization exploits the potential geometry structure of data space (including labeled and unlabeled data) and then significantly leverages the performance in each round. To evaluate the proposed algorithm, we carefully conduct extensive experiments including image segmentation and human activity recognition on popular data-sets respectively. The experimental results demonstrate that our method can achieve a better performance than the traditional active learning methods. (c) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:47 / 56
页数:10
相关论文
共 45 条
[1]  
[Anonymous], 2001, ICML Williamstown
[2]  
[Anonymous], 2009, Adv. Neural Inf. Process. Syst.
[3]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[4]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[5]   Manifold Adaptive Experimental Design for Text Categorization [J].
Cai, Deng ;
He, Xiaofei .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2012, 24 (04) :707-719
[6]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[7]  
Culotta A., 2005, P 20 NAT C ART INT, P746
[8]   Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data [J].
Donoho, DL ;
Grimes, C .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2003, 100 (10) :5591-5596
[9]   The Pascal Visual Object Classes (VOC) Challenge [J].
Everingham, Mark ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) :303-338
[10]  
Fu YW, 2012, LECT NOTES COMPUT SC, V7575, P530, DOI 10.1007/978-3-642-33765-9_38