Multi-label Learning with Label-Specific Feature Selection

被引:10
作者
Yan, Yan [1 ]
Li, Shining [1 ]
Yang, Zhe [1 ]
Zhang, Xiao [1 ]
Li, Jing [1 ]
Wang, Anyi [1 ]
Zhang, Jingyu [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
来源
NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I | 2017年 / 10634卷
关键词
Feature selection; Multi-label learning; Label-specific feature;
D O I
10.1007/978-3-319-70087-8_33
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In multi-label learning, an efficient approach with label-specific features named LIFT has been presented, since different labels may have some distinct characteristics. However, the construction of label-specific features by simply assigning equal weight to each instance ignores the relevance among samples, which might increase the dimensionalities and result in a large amount of redundant information. In order to reduce the redundancy, a novel yet effective multi-label learning approach with weighted label-specific feature selection by using information theory (WFSI-LIFT) is proposed. In WFSI-LIFT, we employ the information theory to implement label-specific feature selection and assign different weights to the different class instance according to imbalance rate(IR). And then, comprehensive experiments across 8 real-world multi-label data sets indicate that, WFSI-LIFT can not only reduce the dimensionalities of label-specific features and enhance the performance compared with LIFT, but also validate the superiority of our approach against other well-established multi-label learning algorithms.
引用
收藏
页码:305 / 315
页数:11
相关论文
共 10 条
[1]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[2]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[3]   Conditional Mutual Information based Feature Selection [J].
Cheng, Hongrong ;
Qin, Zhiguang ;
Qian, Weizhong ;
Liu, Wei .
KAM: 2008 INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING, PROCEEDINGS, 2008, :103-107
[4]   Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy [J].
Peng, HC ;
Long, FH ;
Ding, C .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (08) :1226-1238
[5]   Detecting Novel Associations in Large Data Sets [J].
Reshef, David N. ;
Reshef, Yakir A. ;
Finucane, Hilary K. ;
Grossman, Sharon R. ;
McVean, Gilean ;
Turnbaugh, Peter J. ;
Lander, Eric S. ;
Mitzenmacher, Michael ;
Sabeti, Pardis C. .
SCIENCE, 2011, 334 (6062) :1518-1524
[6]   Multi-label learning with label-specific feature reduction [J].
Xu, Suping ;
Yang, Xibei ;
Yu, Hualong ;
Yu, Dong-Jun ;
Yang, Jingyu ;
Tsang, Eric C. C. .
KNOWLEDGE-BASED SYSTEMS, 2016, 104 :52-61
[7]   ML-KNN: A lazy learning approach to multi-label leaming [J].
Zhang, Min-Ling ;
Zhou, Zhi-Hua .
PATTERN RECOGNITION, 2007, 40 (07) :2038-2048
[8]   Multilabel neural networks with applications to functional genomics and text categorization [J].
Zhang, Min-Ling ;
Zhou, Zhi-Hua .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2006, 18 (10) :1338-1351
[9]   LIFT: Multi-Label Learning with Label-Specific Features [J].
Zhang, Min-Ling ;
Wu, Lei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (01) :107-120
[10]   A Review on Multi-Label Learning Algorithms [J].
Zhang, Min-Ling ;
Zhou, Zhi-Hua .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (08) :1819-1837