A dual-based stochastic inexact algorithm for a class of stochastic nonsmooth convex composite problems

被引:0
|
作者
Gui-Hua Lin
Zhen-Ping Yang
Hai-An Yin
Jin Zhang
机构
[1] Shanghai University,School of Management
[2] Jiaying University,School of Mathematics
[3] Southern University of Science and Technology,Department of Mathematics
[4] Peng Cheng Laboratory,Department of Mathematics, SUSTech International Center for Mathematics, Southern University of Science and Technology, National Center for Applied Mathematics Shenzhen
来源
Computational Optimization and Applications | 2023年 / 86卷
关键词
Stochastic programming; Stochastic approximation; Duality; Convergence rate; 90C06; 90C15; 90C25;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a dual-based stochastic inexact algorithm is developed to solve a class of stochastic nonsmooth convex problems with underlying structure. This algorithm can be regarded as an integration of a deterministic augmented Lagrangian method and some stochastic approximation techniques. By utilizing the sparsity of the second order information, each subproblem is efficiently solved by a superlinearly convergent semismooth Newton method. We derive some almost surely convergence properties and convergence rate of objective values. Furthermore, we present some results related to convergence rate of distance between iteration points and solution set under error bound conditions. Numerical results demonstrate favorable comparison of the proposed algorithm with some existing methods.
引用
收藏
页码:669 / 710
页数:41
相关论文
共 50 条
  • [1] A dual-based stochastic inexact algorithm for a class of stochastic nonsmooth convex composite problems
    Lin, Gui-Hua
    Yang, Zhen-Ping
    Yin, Hai-An
    Zhang, Jin
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 86 (02) : 669 - 710
  • [2] On inexact stochastic splitting methods for a class of nonconvex composite optimization problems with relative error
    Hu, Jia
    Han, Congying
    Guo, Tiande
    Zhao, Tong
    OPTIMIZATION METHODS & SOFTWARE, 2023, 38 (01) : 1 - 33
  • [3] A proximal point algorithm for nonsmooth stochastic programming problems
    Ou, Yigui
    Lin, Haichan
    Wang, Zhigang
    PROCEEDING OF THE SEVENTH INTERNATIONAL CONFERENCE ON INFORMATION AND MANAGEMENT SCIENCES, 2008, 7 : 382 - 384
  • [4] A Stochastic Nesterov’s Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Ruyu Wang
    Chao Zhang
    Lichun Wang
    Yuanhai Shao
    Journal of Scientific Computing, 2022, 93
  • [5] A Stochastic Nesterov's Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Wang, Ruyu
    Zhang, Chao
    Wang, Lichun
    Shao, Yuanhai
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (02)
  • [6] SI-ADMM: A Stochastic Inexact ADMM Framework for Stochastic Convex Programs
    Xie, Yue
    Shanbhag, Uday V.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (06) : 2355 - 2370
  • [7] Dual Solutions in Convex Stochastic Optimization
    Pennanen, Teemu
    Perkkioe, Ari-Pekka
    MATHEMATICS OF OPERATIONS RESEARCH, 2024,
  • [8] INEXACT CUTS IN STOCHASTIC DUAL DYNAMIC PROGRAMMING
    Guigues, Vincent
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 407 - 438
  • [9] A stochastic primal-dual splitting algorithm with variance reduction for composite optimization problems
    Nguyen, Van Dung
    Vu, Bang Cong
    Papadimitriou, Dimitri
    APPLICABLE ANALYSIS, 2024,
  • [10] Solution of Nonconvex Nonsmooth Stochastic Optimization Problems
    Yu. M. Ermoliev
    V. I. Norkin
    Cybernetics and Systems Analysis, 2003, 39 (5) : 701 - 715