Joint learning of multi-label classification and label correlations

被引：0
作者：
He, Zhi-Fen [1 ,2 ]
Yang, Ming [1 ,2 ]
Liu, Hui-Dong [2 ]
机构：
[1] School of Mathematical Sciences, Nanjing Normal University, Nanjing
[2] School of Computer Science and Technology, Nanjing Normal University, Nanjing
来源：
Ruan Jian Xue Bao/Journal of Software | 2014年 / 25卷 / 09期
关键词：
Alternating solution; Conditional dependency network; Hilbert space; Label correlations; Multi-label classification; Multi-label learning; Reproducing kernel;
D O I：
10.13328/j.cnki.jos.004634
中图分类号：
学科分类号：
摘要：
In this paper, joint learning of multi-label classification and label correlations (JMLLC) is proposed. In JMLLC, a directed conditional dependency network is constructed based on class label variables. This not only enables joint learning of independent label classifiers to enhance the performance of label classifiers, but also allows joint learning of label classifiers and label correlations, thereby making the learned label correlations more accurate. JMLLC-LR (JMLLC with logistic regression) and JMLLC-LS (JMLLC with least squares), are proposed respectively by adopting two different loss functions: logistic regression and least squares, and are both extended to the reproducing kernel Hilbert space (RKHS). Finally, both JMLLC-LR and JMLLC-LS can be solved by alternating solution approaches. Experimental results on twenty benchmark data sets based on five different evaluation criteria demonstrate that JMLLC outperforms the state-of-the-art MLL algorithms. © Copyright 2014, Institute of Software, the Chinese Academy of Science. All Rights Reserved.
引用
收藏
页码：1967 / 1981
页数：14
相关论文
共 32 条
  • [1] Zhang M.L., Zhou Z.H., A review on multi-label learning algorithms, IEEE Trans. on Knowledge and Data Engineering, 26, 8, pp. 1819-1837, (2014)
  • [2] Schapire R.E., Singer Y., Boostexter: A boosting-based system for text categorization, Machine Learning, 39, 2, pp. 135-168, (2000)
  • [3] Zhang M.L., Zhou Z.H., Multilabel neural networks with applications to functional genomics and text categorization, IEEE Trans. on Knowledge and Data Engineering, 18, 10, pp. 1338-1351, (2006)
  • [4] Boutell M.R., Luo J., Shen X., Brown C.M., Learning multi-label scene classification, Pattern Recognition, 37, 9, pp. 1757-1771, (2004)
  • [5] Lo H.Y., Wang J.C., Wang H.M., Lin S.D., Cost-Sensitive multi-label learning for audio tag annotation and retrieval, IEEE Trans. on Multimedia, 13, 3, pp. 518-529, (2011)
  • [6] Elisseeff A., Weston J., A kernel method for multi-labelled classification, Proc. of the Advances in Neural Information Processing Systems 14, pp. 681-687, (2002)
  • [7] Zhang M.L., Zhou Z.H., ML-KNN: A lazy learning approach to multi-label learning, Pattern Recognition, 40, 7, pp. 2038-2048, (2007)
  • [8] Furnkranz J., Hullermeier E., Mencia E.L., Brinker K., Multilabel classification via calibrated label ranking, Machine Learning, 73, 2, pp. 133-153, (2008)
  • [9] Read J., Pfahringer B., Holmes G., Frank E., Classifier chains for multi-label classification, Machine Learning, 85, 3, pp. 333-359, (2011)
  • [10] Huang S.J., Zhou Z.H., Multi-Label learning by exploiting label correlations locally, Proc. of the 26th AAAI Conf. on Artificial Intelligence, pp. 949-955, (2012)
1234