Imbalanced least squares regression with adaptive weight learning

被引:32
作者
Li, Yanting [1 ]
Jin, Junwei [2 ]
Ma, Jiangtao [1 ]
Zhu, Fubao [1 ]
Jin, Baohua [1 ]
Liang, Jing [3 ]
Chen, C. L. Philip [4 ]
机构
[1] Zhengzhou Univ Light Ind, Coll Comp & Commun Engn, Zhengzhou 450001, Peoples R China
[2] Henan Univ Technol, Sch Artificial Intelligence & Big Data, Zhengzhou 450001, Peoples R China
[3] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
[4] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Imbalanced classification; Least squares regression; Adaptive weight learning; Label relaxation; Margin; MACHINE; SMOTE;
D O I
10.1016/j.ins.2023.119541
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Least squares regression (LSR) has demonstrated promising performance in various classification tasks owing to its effectiveness and efficiency. However, there are some deficiencies that seriously hinder its application in imbalanced data scenarios. The first is that LSR strongly relies on a balanced class distribution. A severely imbalanced class distribution may seriously damage the effectiveness of the algorithm. Second, the utilized binary label matrix in the conventional LSR model may be too strict to learn a discriminative transformation matrix for imbalanced learning. To address the above issues, in this paper, an adaptive weight learning mechanism and label relaxation constraint are proposed and incorporated into the framework of LSR to tackle the imbalanced classification problem. The weight of each sample can be adaptively obtained according to the original distribution information of the imbalanced data, in which the importance of minority class samples can be better reflected with larger weights. A new label relaxation matrix consisting of the original label matrix and auxiliary matrix is constructed to widen the margins between different classes. Further, we provide an iterative algorithm with fast convergence to solve the resulting optimization problem. Extensive experimental results on diverse binary-class and multi-class imbalanced datasets show that the proposed method outperforms many other state-of-the-art imbalanced learning approaches.
引用
收藏
页数:17
相关论文
共 49 条
[1]   MWMOTE-Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning [J].
Barua, Sukarna ;
Islam, Md. Monirul ;
Yao, Xin ;
Murase, Kazuyuki .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (02) :405-425
[2]  
Batista G.E., 2004, ACM SIGKDD EXPLORATI, V6, P20, DOI [10.1145/1007730.1007735, DOI 10.1145/1007730.1007735]
[3]   Cost-Sensitive Awareness-Based SAR Automatic Target Recognition for Imbalanced Data [J].
Cao, Changjie ;
Cui, Zongyong ;
Wang, Liying ;
Wang, Jielei ;
Cao, Zongjie ;
Yang, Jianyu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data [J].
Castro, Cristiano L. ;
Braga, Antonio P. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (06) :888-899
[5]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[6]   Learning Linear Regression via Single-Convolutional Layer for Visual Object Tracking [J].
Chen, Kai ;
Tao, Wenbing .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (01) :86-97
[7]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[8]   RVGAN-TL: A generative adversarial networks and transfer learning-based hybrid approach for imbalanced data classification [J].
Ding, Hongwei ;
Sun, Yu ;
Huang, Nana ;
Shen, Zhidong ;
Wang, Zhenyu ;
Iftekhar, Adnan ;
Cui, Xiaohui .
INFORMATION SCIENCES, 2023, 629 :184-203
[9]  
Drummond Chris., 2003, C45 CLASS IMBALANCE
[10]   Graph-Based Class-Imbalance Learning With Label Enhancement [J].
Du, Guodong ;
Zhang, Jia ;
Jiang, Min ;
Long, Jinyi ;
Lin, Yaojin ;
Li, Shaozi ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) :6081-6095