A numerical study of applying spectral-step subgradient method for solving nonsmooth unconstrained optimization problems

被引:3
作者
Loreto, M. [1 ]
Xu, Y. [1 ]
Kotval, D. [2 ]
机构
[1] Univ Washington Bothell, Sch Sci Technol Engn & Math STEM, 18115 Campus Way NE, Bothell, WA 98011 USA
[2] Middle Tennessee State Univ, Dept Math Sci, 1301 East Main St, Murfreesboro, TN 37132 USA
基金
美国国家科学基金会;
关键词
Nonsmooth optimization; Subgradient methods; Spectral gradient methods; Nonmonotone line search; BARZILAI;
D O I
10.1016/j.cor.2018.12.006
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The purpose of this work is two-fold. First, we present the spectral-step subgradient method to solve nonsmooth unconstrained optimization problems. It combines the classical subgradient approach and a nonmonotone linesearch with the spectral step length, which does not require any previous knowledge of the optimal value. We focus on the interesting case in which the objective function is convex and continuously differentiable almost everywhere, and it is often non-differentiable at minimizers. Secondly, we use performance profiles to compare the spectral-step subgradient method with other subgradient methods. This comparison will allow us to place the spectral-step subgradient algorithm among other subgradient algorithms. Published by Elsevier Ltd.
引用
收藏
页码:90 / 97
页数:8
相关论文
共 10 条
  • [1] Weak subgradient method for solving nonsmooth nonconvex optimization problems
    Yalcin, Gulcin Dinc
    Kasimbeyli, Refail
    OPTIMIZATION, 2021, 70 (07) : 1513 - 1553
  • [2] Spectral projected subgradient method for nonsmooth convex optimization problems
    Nataša Krejić
    Nataša Krklec Jerinkić
    Tijana Ostojić
    Numerical Algorithms, 2023, 93 : 347 - 365
  • [3] Spectral projected subgradient method for nonsmooth convex optimization problems
    Krejic, Natasa
    Jerinkic, Natasa Krklec
    Ostojic, Tijana
    NUMERICAL ALGORITHMS, 2023, 93 (01) : 347 - 365
  • [4] A New Descent Algorithm Using the Three-Step Discretization Method for Solving Unconstrained Optimization Problems
    Torabi, Mina
    Hosseini, Mohammad-Mehdi
    MATHEMATICS, 2018, 6 (04):
  • [5] Accelerated Double Direction Method for Solving Unconstrained Optimization Problems
    Petrovic, Milena J.
    Stanimirovic, Predrag S.
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2014, 2014
  • [6] Accelerated multiple step-size methods for solving unconstrained optimization problems
    Ivanov, Branislav
    Stanimirovic, Predrag S.
    Milovanovic, Gradimir, V
    Djordjevic, Snezana
    Brajevic, Ivona
    OPTIMIZATION METHODS & SOFTWARE, 2021, 36 (05) : 998 - 1029
  • [7] A Smooth Method for Solving Non-Smooth Unconstrained Optimization Problems
    Rahmanpour, F.
    Hosseini, M. M.
    JOURNAL OF MATHEMATICAL EXTENSION, 2016, 10 (03) : 11 - 33
  • [8] A MODIFIED ALGORITHM OF STEEPEST DESCENT METHOD FOR SOLVING UNCONSTRAINED NONLINEAR OPTIMIZATION PROBLEMS
    Liu, Chein-Shan
    Chang, Jiang-Ren
    Chen, Yung-Wei
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2015, 23 (01): : 88 - 97
  • [9] CONVERGENCE PROPERTIES OF STOCHASTIC PROXIMAL SUBGRADIENT METHOD IN SOLVING A CLASS OF COMPOSITE OPTIMIZATION PROBLEMS WITH CARDINALITY REGULARIZER
    Hu, Xiaoyin
    Liu, Xin
    Xiao, Nachuan
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2024, 20 (05) : 1934 - 1950
  • [10] AN-SPS: adaptive sample size nonmonotone line search spectral projected subgradient method for convex constrained optimization problems
    Krklec Jerinkic, Natasa
    Ostojic, Tijana
    OPTIMIZATION METHODS & SOFTWARE, 2024, 39 (05) : 1143 - 1167