Dual Perspective of Label-Specific Feature Learning for Multi-Label Classification

被引:0
作者
Hang, Jun-Yi [1 ]
Zhang, Min-Ling [1 ]
机构
[1] Southeast University, Nanjing
基金
中国国家自然科学基金;
关键词
label-specific features; Machine learning; missing labels; multi-label classification; partial labels;
D O I
10.1145/3705006
中图分类号
学科分类号
摘要
Label-specific features work as an effective supervised feature manipulation strategy to account for distinct discriminative properties of each class label in multi-label classification. Existing approaches implement this strategy in its primal form, i.e., finding the most pertinent features specific to each class label and directly inducing classifiers on these features. Instead of such a straightforward implementation, a dual perspective for label-specific feature learning is investigated in this article. As a dual problem of existing primal one, we consider label-specific discriminative properties by identifying non-informative features for each class label and making the discrimination process immutable to variations of identified features. Accordingly, a perturbation-based approach Dela is presented, which endows classifiers with immutability on simultaneously identified non-informative features by solving a probabilistically relaxed expected risk minimization problem. Furthermore, we touch the realistic issue of label-specific feature learning in a weakly supervised scenario via extending Dela to accommodate to multi-label data with missing labels. Comprehensive experiments show that our approach outperforms the state-of-the-art counterparts. © 2024 Copyright held by the owner/author(s).
引用
收藏
相关论文
共 98 条
  • [81] Xu M., Jin R., Zhou Z.-H., Speedup matrix completion with side information: Application to multi-label learning, Proceedings of the 26th International Conference on Neural Information Processing Systems, pp. 2301-2309, (2013)
  • [82] Yazici V.O., Gonzalez-Garcia A., Ramisa A., Twardowski B., van de Weijer J., Orderless recurrent models for multi-label classification, Proceedings of the 33rd IEEE Conference on Computer Vision and Pattern Recognition, pp. 13437-13446, (2020)
  • [83] Yeh C.K., Wu W.C., Ko W.J., Wang Y.C.F., Learning deep latent spaces for multi-label classification, Proceedings of the 31st AAAI Conference on Artificial Intelligence, pp. 2838-2844, (2017)
  • [84] Yu H.-F., Jain P., Kar P., Dhillon I.S., Large-scale multi-label learning with missing labels, Proceedings of the 31th International Conference on Machine Learning, pp. 593-601, (2014)
  • [85] Yu Z.-B., Zhang M.-L., Multi-label classification with label-specific feature generation: A wrapped approach, IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 9, pp. 5199-5210, (2022)
  • [86] Zhan W., Zhang M.-L., Multi-label learning with label-specific features via clustering ensemble, Proceedings of the 4th IEEE International Conference on Data Science and Advanced Analytics, pp. 129-136, (2017)
  • [87] Zhang C., Li Z., Multi-label learning with label-specific features via weighting and label entropy guided clustering ensemble, Neurocomputing, 419, 2021, pp. 59-69, (2021)
  • [88] Zhang H., Cisse M., Dauphin Y.N., Lopez-Paz D., Mixup: Beyond empirical risk minimization, Proceedings of the 6th International Conference on Learning Representations, (2018)
  • [89] Zhang J., Fang M., Li X., Multi-label learning with discriminative features for each label, Neurocomputing, 154, pp. 305-316, (2015)
  • [90] Zhang J., Li C., Cao D., Lin Y., Su S., Dai L., Li S., Multi-label learning with label-specific features by resolving label correlations, Knowledge-Based Systems, 159, 2018, pp. 148-157, (2018)