Bregman Distance to L1 Regularized Logistic Regression

被引:0
|
作者
Das Gupta, Mithun [1 ]
Huang, Thomas S. [1 ]
机构
[1] Univ Illinois, Urbana, IL USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we investigate the relationship between Bregman distances and regularized Logistic Regression model. We convert L1-regularized logistic regression (LR) into more general Bregman divergence framework and propose a primal-dual method based algorithm for learning the parameters of the model. The proposed method utilizes L1 regularization to incorporate parameter sparsity into the divergence minimization scheme. We perform tests on public domain data sets and produce results which are amongst the best reported.
引用
收藏
页码:2577 / 2580
页数:4
相关论文
共 50 条
  • [1] L1/2 regularized Logistic regression
    Zhao, Q. (zhao.qian@stu.xjtu.edu.cn), 1600, Science Press (25):
  • [2] Krylov subspace solvers for l1 regularized logistic regression method
    El Guide, M.
    Jbilou, K.
    Koukouvinos, C.
    Lappa, A.
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2023, 52 (06) : 2738 - 2751
  • [3] Comparative study of L1 regularized logistic regression methods for variable selection
    El Guide, M.
    Jbilou, K.
    Koukouvinos, C.
    Lappa, A.
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2022, 51 (09) : 4957 - 4972
  • [4] A PRIMAL AND DUAL ACTIVE SET ALGORITHM FOR TRUNCATED L1 REGULARIZED LOGISTIC REGRESSION
    Kang, Lican
    Luo, Yuan
    Yang, Jerry Zhijian
    Zhu, Chang
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (04) : 2452 - 2463
  • [5] L1-2 Regularized Logistic Regression
    Qin, Jing
    Lou, Yifei
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 779 - 783
  • [6] An Improved GLMNET for L1-regularized Logistic Regression
    Yuan, Guo-Xun
    Ho, Chia-Hua
    Lin, Chih-Jen
    JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 1999 - 2030
  • [7] Truncated L1 Regularized Linear Regression: Theory and Algorithm
    Dai, Mingwei
    Dai, Shuyang
    Huang, Junjun
    Kang, Lican
    Lu, Xiliang
    COMMUNICATIONS IN COMPUTATIONAL PHYSICS, 2021, 30 (01) : 190 - 209
  • [8] Distributed Coordinate Descent for L1-regularized Logistic Regression
    Trofimov, Ilya
    Genkin, Alexander
    ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS, AIST 2015, 2015, 542 : 243 - 254
  • [9] Tuning parameter calibration for l1-regularized logistic regression
    Li, Wei
    Lederer, Johannes
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2019, 202 : 80 - 98
  • [10] Multiplicative updates for L1-regularized linear and logistic regression
    Sha, Fei
    Park, Y. Albert
    Saul, Lawrence K.
    ADVANCES IN INTELLIGENT DATA ANALYSIS VII, PROCEEDINGS, 2007, 4723 : 13 - +