FAST MARGIN-BASED COST-SENSITIVE CLASSIFICATION

被引:0
作者
Nan, Feng [1 ]
Wang, Joseph [1 ]
Trapeznikov, Kirill [1 ]
Saligrama, Venkatesh [1 ]
机构
[1] Boston Univ, Boston, MA 02215 USA
来源
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2014年
关键词
cost-sensitive; learning with test time budget; dynamic feature selection;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
We present a novel classification algorithm for learning with test time budgets. In this setting, the goal is to reduce feature acquisition cost while maintaining classification accuracy. For every decision, our approach dynamically selects features based on previously observed information. Once a desired confidence of a decision is achieved, the acquisition stops and the test instance is classified. Our approach can be used in conjunction with many popular margin based classification algorithms. We use margin information from training data in the partial feature neighborhood of a test point to compute a probability of correct classification. This estimate is used to either select the next feature or to stop. We compare our algorithm to other cost-sensitive methods on real world datasets. The experiments demonstrate that our algorithm provides an accurate estimate of classification confidence and outperforms other approaches while being significantly more efficient in computation.
引用
收藏
页数:5
相关论文
共 14 条
[1]  
[Anonymous], 2011, ADV NEURAL INFORM PR
[2]  
[Anonymous], 2013, P 30 INT C MACHINE L
[3]  
Bache K., 2013, UCI Machine Learning Repository
[4]  
Chapelle O., 2009, P 18 ACM C INF KNOWL, P621, DOI DOI 10.1145/1645953.1646033
[5]  
Chen M., 2012, INT C ART INT STAT A, P235
[6]   SUPPORT-VECTOR NETWORKS [J].
CORTES, C ;
VAPNIK, V .
MACHINE LEARNING, 1995, 20 (03) :273-297
[7]   A decision-theoretic generalization of on-line learning and an application to boosting [J].
Freund, Y ;
Schapire, RE .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1997, 55 (01) :119-139
[8]  
Karayev S., 2012, Advances in Neural Information Processing Systems, V25, P899
[9]  
Ross Stephane, 2011, JMLR Proceedings, V15, P627
[10]  
Trapeznikov K., 2013, Machine Learning, P1