Stochastic Gradients: Optimization, Simulation, Randomization, and Sensitivity Analysis

被引：0
|
作者：
Fu, Michael C. [1 ,2 ]
Hu, Jiaqiao [3 ]
Scheinberg, Katya [4 ]
机构：
[1] Univ Maryland, Robert H Smith Sch Business, College Pk, MD 20742 USA
[2] Univ Maryland, Inst Syst Res, College Pk, MD 20742 USA
[3] SUNY Stony Brook, Dept Appl Math & Stat, Stony Brook, NY USA
[4] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA USA
来源：
IISE TRANSACTIONS | 2025年
基金：
美国国家科学基金会;
关键词：
Stochastic gradients; perturbation analysis; automatic differentiation; likelihood ratio method; optimization; sensitivity analysis; stochastic gradient descent; stochastic approximation; stochastic optimization; simulation optimization; PERTURBATION ANALYSIS; APPROXIMATION ALGORITHMS; COMPOSITE OPTIMIZATION; SEARCH; CONVERGENCE; COMPLEXITY; RATES;
D O I：
10.1080/24725854.2025.2469839
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Big data and high-dimensional optimization problems in operations research (OR) and artificial intelligence (AI) have brought stochastic gradients to the forefront. This article provides a view of research and applications in stochastic gradient estimation from multiple perspectives, as seminal advances have come from diverse and disparate research fields, including operations research/management science (OR/MS), industrial/systems engineering (ISE), optimal/stochastic control, statistics, and more recently from the computer science (CS) AI machine learning (ML) community.
引用
收藏
页数：17
相关论文
共 50 条
  • [41] Sensitivity analysis in optimization and reliability problems
    Castillo, Enrique
    Minguez, Roberto
    Castillo, Carmen
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2008, 93 (12) : 1788 - 1800
  • [42] UNBIASED ESTIMATES FOR GRADIENTS OF STOCHASTIC NETWORK PERFORMANCE-MEASURES
    KRIVULIN, N
    ACTA APPLICANDAE MATHEMATICAE, 1993, 33 (01) : 21 - 43
  • [43] Sensitivity analysis and optimization of building operations
    Gunay, H. Burak
    Ouf, Mohamed
    Newsham, Guy
    O'Brien, William
    ENERGY AND BUILDINGS, 2019, 199 : 164 - 175
  • [44] PROJECTED STOCHASTIC GRADIENTS FOR CONVEX CONSTRAINED PROBLEMS IN HILBERT SPACES
    Geiersbach, Caroline
    Pflug, Georg Ch
    SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (03) : 2079 - 2099
  • [45] A Stochastic Approximation Method for Simulation-Based Quantile Optimization
    Hu, Jiaqiao
    Peng, Yijie
    Zhang, Gongbo
    Zhang, Qi
    INFORMS JOURNAL ON COMPUTING, 2022, 34 (06) : 2889 - 2907
  • [46] Simulation-based Optimization of Solar Combisystem Sensitivity Analysis at Optimum
    Kusyy, Oleh
    Vajen, Klaus
    PROCEEDINGS OF THE ISES EUROSUN 2018 CONFERENCE - 12TH INTERNATIONAL CONFERENCE ON SOLAR ENERGY FOR BUILDINGS AND INDUSTRY, 2018, : 385 - 396
  • [47] Simulation, sensitivity analysis and optimization of a commercial continuous catalytic naphtha reformer
    Weifeng, Hou
    Xiuqiang, Zheng
    Yanping, Hong
    Fengyue, Jiang
    Information Technology Journal, 2013, 12 (19) : 4953 - 4958
  • [48] Generalized surrogate problem methodology for online stochastic discrete optimization
    Gokbayrak, K
    Cassandras, CG
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2002, 114 (01) : 97 - 132
  • [49] A Stochastic Second-Order Proximal Method for Distributed Optimization
    Qiu, Chenyang
    Zhu, Shanying
    Ou, Zichong
    Lu, Jie
    IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 1405 - 1410
  • [50] Block Mirror Stochastic Gradient Method For Stochastic Optimization
    Yang, Jinda
    Song, Haiming
    Li, Xinxin
    Hou, Di
    JOURNAL OF SCIENTIFIC COMPUTING, 2023, 94 (03)
12345