Stochastic Gradients: Optimization, Simulation, Randomization, and Sensitivity Analysis

被引：0
|
作者：
Fu, Michael C. [1 ,2 ]
Hu, Jiaqiao [3 ]
Scheinberg, Katya [4 ]
机构：
[1] Univ Maryland, Robert H Smith Sch Business, College Pk, MD 20742 USA
[2] Univ Maryland, Inst Syst Res, College Pk, MD 20742 USA
[3] SUNY Stony Brook, Dept Appl Math & Stat, Stony Brook, NY USA
[4] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn, Atlanta, GA USA
来源：
IISE TRANSACTIONS | 2025年
基金：
美国国家科学基金会;
关键词：
Stochastic gradients; perturbation analysis; automatic differentiation; likelihood ratio method; optimization; sensitivity analysis; stochastic gradient descent; stochastic approximation; stochastic optimization; simulation optimization; PERTURBATION ANALYSIS; APPROXIMATION ALGORITHMS; COMPOSITE OPTIMIZATION; SEARCH; CONVERGENCE; COMPLEXITY; RATES;
D O I：
10.1080/24725854.2025.2469839
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
Big data and high-dimensional optimization problems in operations research (OR) and artificial intelligence (AI) have brought stochastic gradients to the forefront. This article provides a view of research and applications in stochastic gradient estimation from multiple perspectives, as seminal advances have come from diverse and disparate research fields, including operations research/management science (OR/MS), industrial/systems engineering (ISE), optimal/stochastic control, statistics, and more recently from the computer science (CS) AI machine learning (ML) community.
引用
收藏
页数：17
相关论文
共 50 条
  • [31] Operation analysis of Eleviyan irrigation reservoir dam by optimization and stochastic simulation
    M. Taghi Sattari
    Halit Apaydin
    Fazli Ozturk
    Stochastic Environmental Research and Risk Assessment, 2009, 23 : 1187 - 1201
  • [32] Communication-efficient algorithms for decentralized and stochastic optimization
    Lan, Guanghui
    Lee, Soomin
    Zhou, Yi
    MATHEMATICAL PROGRAMMING, 2020, 180 (1-2) : 237 - 284
  • [33] Stochastic Fixed Point Optimization Algorithm for Classifier Ensemble
    Iiduka, Hideaki
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (10) : 4370 - 4380
  • [34] Variance decompositions of nonlinear time series using stochastic simulation and sensitivity analysis
    T. J. Harris
    W. Yu
    Statistics and Computing, 2012, 22 : 387 - 396
  • [35] Stochastic Zeroth-order Optimization in High Dimensions
    Wang, Yining
    Du, Simon S.
    Balakrishnan, Sivaraman
    Singh, Aarti
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [36] Variance decompositions of nonlinear time series using stochastic simulation and sensitivity analysis
    Harris, T. J.
    Yu, W.
    STATISTICS AND COMPUTING, 2012, 22 (02) : 387 - 396
  • [37] Variable Smoothing for Convex Optimization Problems Using Stochastic Gradients
    Bot, Radu Ioan
    Boehm, Axel
    JOURNAL OF SCIENTIFIC COMPUTING, 2020, 85 (02)
  • [38] SIMULATION-BASED OPTIMIZATION BY NEW STOCHASTIC APPROXIMATION ALGORITHM
    Xu, Zi
    Li, Yingying
    Zhao, Xingfang
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2014, 31 (04)
  • [39] Operation analysis of Eleviyan irrigation reservoir dam by optimization and stochastic simulation
    Sattari, M. Taghi
    Apaydin, Halit
    Ozturk, Fazli
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2009, 23 (08) : 1187 - 1201
  • [40] A multiobjective stochastic simulation optimization algorithm
    Gonzalez, Sebastian Rojas
    Jalali, Hamed
    Van Nieuwenhuyse, Inneke
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2020, 284 (01) : 212 - 226
12345