Distributed non-convex regularization for generalized linear regression

被引:1
|
作者
Sun, Xiaofei [1 ]
Zhang, Jingyu [1 ]
Liu, Zhongmo [2 ]
Polat, Kemal [3 ]
Gai, Yujie [4 ]
Gao, Wenliang [5 ]
机构
[1] Shandong Technol & Business Univ, Sch Stat, Yantai, Peoples R China
[2] Natl Univ Malaysia, Grad Sch Business, Bangi, Malaysia
[3] Bolu Abant Izzet Baysal Univ, Dept Elect & Elect Engn, Bolu, Turkiye
[4] Cent Univ Finance & Econ, Sch Stat & Math, Beijing, Peoples R China
[5] Mianyang Teachers Coll, Sch Econ & Management, Mianyang, Peoples R China
关键词
Generalized linear regression; Big data; Variable selection; Regularized learning; SELECTION;
D O I
10.1016/j.eswa.2024.124177
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Distributed penalized generalized linear regression algorithms have been widely studied in recent years. However, they all assume that the data should be randomly distributed. In real applications, this assumption is not necessarily true, since the whole data are often stored in a non-random manner. To tackle this issue, a non- convex penalized distributed pilot sample surrogate negative log-likelihood learning procedure is developed, which can realize distributed high-dimensional variable selection for generalized linear models, and be adaptive to the non-random situations. The established theoretical results and numerical studies all validate the proposed method.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Distributed Quantile Regression with Non-Convex Sparse Penalties
    Mirzaeifard, Reza
    Gogineni, Vinay Chakravarthi
    Venkategowda, Naveen K. D.
    Werner, Stefan
    2023 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP, SSP, 2023, : 250 - 254
  • [2] A Study on GMLVQ Convex and Non-convex Regularization
    Nova, David
    Estevez, Pablo A.
    ADVANCES IN SELF-ORGANIZING MAPS AND LEARNING VECTOR QUANTIZATION, WSOM 2016, 2016, 428 : 305 - 314
  • [3] Generalized Bregman distances and convergence rates for non-convex regularization methods
    Grasmair, Markus
    INVERSE PROBLEMS, 2010, 26 (11)
  • [4] Regularization with non-convex separable constraints
    Bredies, Kristian
    Lorenz, Dirk A.
    INVERSE PROBLEMS, 2009, 25 (08)
  • [5] Global optimization of non-convex piecewise linear regression splines
    Martinez, Nadia
    Anahideh, Hadis
    Rosenberger, Jay M.
    Martinez, Diana
    Chen, Victoria C. P.
    Wang, Bo Ping
    JOURNAL OF GLOBAL OPTIMIZATION, 2017, 68 (03) : 563 - 586
  • [6] Global optimization of non-convex piecewise linear regression splines
    Nadia Martinez
    Hadis Anahideh
    Jay M. Rosenberger
    Diana Martinez
    Victoria C. P. Chen
    Bo Ping Wang
    Journal of Global Optimization, 2017, 68 : 563 - 586
  • [7] Non-Convex Distributed Optimization
    Tatarenko, Tatiana
    Touri, Behrouz
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (08) : 3744 - 3757
  • [8] A non-convex regularization approach for compressive sensing
    Fan, Ya-Ru
    Buccini, Alessandro
    Donatelli, Marco
    Huang, Ting-Zhu
    ADVANCES IN COMPUTATIONAL MATHEMATICS, 2019, 45 (02) : 563 - 588
  • [9] A non-convex regularization approach for compressive sensing
    Ya-Ru Fan
    Alessandro Buccini
    Marco Donatelli
    Ting-Zhu Huang
    Advances in Computational Mathematics, 2019, 45 : 563 - 588
  • [10] On Tikhonov regularization with non-convex sparsity constraints
    Zarzer, Clemens A.
    INVERSE PROBLEMS, 2009, 25 (02)