Label-Aware Global Consistency for Multi-Label Learning with Single Positive Labels

被引:0
|
作者
Xie, Ming-Kun [1 ]
Xiao, Jia-Hao [1 ]
Huang, Sheng-Jun [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing 211106, Peoples R China
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022) | 2022年
基金
国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In single positive multi-label learning (SPML), only one of multiple positive labels is observed for each instance. The previous work trains the model by simply treating unobserved labels as negative ones, and designs the regularization to constrain the number of expected positive labels. However, in many real-world scenarios, the true number of positive labels is unavailable, making such methods less applicable. In this paper, we propose to solve SPML problems by designing a Label-Aware global Consistency (LAC) regularization, which leverages the manifold structure information to enhance the recovery of potential positive labels. On one hand, we first perform pseudo-labeling for each unobserved label based on its prediction probability. The consistency regularization is then imposed on model outputs to balance the fitting of identified labels and exploring of potential positive labels. On the other hand, by enforcing label-wise embeddings to maintain global consistency, LAC loss encourages the model to learn more distinctive representations, which is beneficial for recovering the information of potential positive labels. Experiments on multiple benchmark datasets validate that the proposed method can achieve state-of-the-art performance for solving SPML tasks.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Pseudo Labels for Imbalanced Multi-Label Learning
    Zeng, Wenrong
    Chen, Xuewen
    Cheng, Hong
    2014 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2014, : 25 - 31
  • [22] Multi-Label Learning with Emerging New Labels
    Zhu, Yue
    Ting, Kai-Ming
    Zhou, Zhi-Hua
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 1371 - 1376
  • [23] Label-Aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification
    Huang, Xin
    Chen, Boli
    Xiao, Lin
    Yu, Jian
    Jing, Liping
    NEURAL PROCESSING LETTERS, 2022, 54 (05) : 3601 - 3617
  • [24] Label-Aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification
    Xin Huang
    Boli Chen
    Lin Xiao
    Jian Yu
    Liping Jing
    Neural Processing Letters, 2022, 54 : 3601 - 3617
  • [25] Multi-Label Learning with Global and Local Label Correlation
    Zhu, Yue
    Kwok, James T.
    Zhou, Zhi-Hua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (06) : 1081 - 1094
  • [26] Multi-Label classification with Missing Labels by Preserving Feature-Label Space Consistency
    Zhang, Zan
    Zhang, Depeng
    Wu, Gongqing
    2023 IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH, ICKG, 2023, : 192 - 199
  • [27] Multi-label learning with missing labels using sparse global structure for label-specific features
    Kumar, Sanjay
    Ahmadi, Nadira
    Rastogi, Reshma
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18155 - 18170
  • [28] Multi-label learning with missing labels using sparse global structure for label-specific features
    Sanjay Kumar
    Nadira Ahmadi
    Reshma Rastogi
    Applied Intelligence, 2023, 53 : 18155 - 18170
  • [29] Global and local multi-view multi-label learning with incomplete views and labels
    Changming Zhu
    Panhong Wang
    Lin Ma
    Rigui Zhou
    Lai Wei
    Neural Computing and Applications, 2020, 32 : 15007 - 15028
  • [30] Global and local multi-view multi-label learning with incomplete views and labels
    Zhu, Changming
    Wang, Panhong
    Ma, Lin
    Zhou, Rigui
    Wei, Lai
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (18): : 15007 - 15028