Method for Improving Gradient Boosting Learning Efficiency Based on Modified Loss Functions

被引：0
|
作者：
Korolev, N. S. [1 ]
Senko, O. V. [2 ]
机构：
[1] Lomonosov Moscow State Univ, Moscow 119991, Russia
[2] Russian Acad Sci, Fed Res Ctr Comp Sci & Control, Moscow 119333, Russia
来源：
AUTOMATION AND REMOTE CONTROL | 2022年 / 83卷 / 12期
关键词：
gradient boosting; decision tree; loss function; machine learning; data analysis;
D O I：
10.1134/S00051179220120074
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
We consider a new method to improve the quality of training in gradient boosting as wellas to increase its generalization performance based on the use of modified loss functions. Incomputational experiments, the possible applicability of this method to improve the quality ofgradient boosting when solving various classification and regression problems on real data isshown.
引用
收藏
页码：1935 / 1943
页数：9
相关论文
共 50 条
  • [21] Improving Financial Distress Prediction Using Financial Network-Based Information and GA-Based Gradient Boosting Method
    Liu, Jiaming
    Wu, Chong
    Li, Yongli
    COMPUTATIONAL ECONOMICS, 2019, 53 (02) : 851 - 872
  • [22] AN OPTIMAL BOOSTING ALGORITHM BASED ON NONLINEAR CONJUGATE GRADIENT METHOD
    Choi, Jooyeon
    Jeong, Bora
    Park, Yesom
    Seo, Jiwon
    Min, Chohong
    JOURNAL OF THE KOREAN SOCIETY FOR INDUSTRIAL AND APPLIED MATHEMATICS, 2018, 22 (01) : 1 - 13
  • [23] Rolexboost: A Rotation-Based Boosting Algorithm With Adaptive Loss Functions
    Yang, Dong-Hyuk
    Lee, Hyeong-Jun
    Lim, Dong-Joon
    IEEE ACCESS, 2020, 8 : 41037 - 41044
  • [24] Robust statistical boosting with quantile-based adaptive loss functions
    Speller, Jan
    Staerk, Christian
    Mayr, Andreas
    INTERNATIONAL JOURNAL OF BIOSTATISTICS, 2023, 19 (01): : 111 - 129
  • [25] FLAGB: Focal Loss based Adaptive Gradient Boosting for Imbalanced Traffic Classification
    Guo, Yu
    Li, Zhenzhen
    Li, Zhen
    Xiong, Gang
    Jiang, Minghao
    Gou, Gaopeng
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [26] An Adjective Selection Personality Assessment Method Using Gradient Boosting Machine Learning
    Fernandes, Bruno
    Gonzalez-Briones, Alfonso
    Novais, Paulo
    Calafate, Miguel
    Analide, Cesar
    Neves, Jose
    PROCESSES, 2020, 8 (05)
  • [27] Pre Screening of Cervical Cancer Through Gradient Boosting Ensemble Learning Method
    Priya, S.
    Karthikeyan, N. K.
    Palanikkumar, D.
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 35 (03): : 2673 - 2685
  • [28] Development of a predictive emissions model using a gradient boosting machine learning method
    Si, Minxing
    Du, Ke
    ENVIRONMENTAL TECHNOLOGY & INNOVATION, 2020, 20
  • [29] Improving the separation of direct and diffuse solar radiation components using machine learning by gradient boosting
    Aler, Ricardo
    Galvan, Ines M.
    Ruiz-Arias, Jose A.
    Gueymard, Christian A.
    SOLAR ENERGY, 2017, 150 : 558 - 569
  • [30] Improving order and efficiency: Composition with a modified Newton's method
    Grau-Sanchez, Miquel
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2009, 231 (02) : 592 - 597
12345