Formal Comparison of Simultaneous Perturbation Stochastic Approximation and Random Direction Stochastic Approximation

被引：2

作者：

Peng, Ducheng ^{[1
]}

Chen, Yiwen ^{[2
]}

Spall, James C. ^{[1
,3
]}

机构：

[1] Johns Hopkins Univ, Appl Math & Stat Dept, Whitehead Hall,3400 North Charles St, Baltimore, MD 21218 USA

[2] Johns Hopkins Univ, Appl Math & Stat Dept, Baltimore, MD USA

[3] JHU, Appl Phys Lab & Res, Baltimore, MD USA

来源：

2023 AMERICAN CONTROL CONFERENCE, ACC | 2023年

关键词：

OPTIMIZATION; ALGORITHMS; CONTROLLER; SYSTEMS;

D O I：

10.23919/ACC55779.2023.10156400

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Stochastic approximation (SA) algorithms can be used in system optimization problems when only noisy measurements of a system are available. This paper formally compares the performance of two popular SA algorithms in a multivariate Kiefer-Wolfowitz setting of simultaneous-perturbation SA (SPSA) and the random-directions SA (RDSA). This paper provides sufficient conditions to demonstrate which algorithm has the smaller asymptotic mean squared error (MSE) and numerically presents comparison of SPSA and RDSA in a test function and a model-free control system. The theory and supporting numerics indicate that SPSA has better efficiency (lower MSE) across a broad range of problem settings.

引用

页码：744 / 749

页数：6

共 50 条

[31] Distributed Tracking via Simultaneous Perturbation Stochastic Approximation-based Consensus Algorithm [J].

Erofeeva, Victoria ;

Granichin, Oleg ;

Amelina, Natalia ;

Ivanskiy, Yury ;

Jiang, Yuming .

2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, :6050-6055

[32] Stochastic approximation driven particle swarm optimization with simultaneous perturbation - Who will guide the guide? [J].

Kiranyaz, Serkan ;

Ince, Turker ;

Gabbouj, Moncef .

APPLIED SOFT COMPUTING, 2011, 11 (02) :2334-2347

[33] Synthesis of Sparse Linear Arrays Using Vector Mapping and Simultaneous Perturbation Stochastic Approximation [J].

Lin, Zhiqiang ;

Jia, Weimin ;

Yao, Minli ;

Hao, Luyao .

IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2012, 11 :220-223

[34] Rate of Convergence Analysis of Simultaneous Perturbation Stochastic Approximation Algorithm for Time-Varying Loss Function [J].

Wang, Qi ;

Ye, Ming .

2014 AMERICAN CONTROL CONFERENCE (ACC), 2014, :5192-5197

[35] Performance analysis of model-free PID tuning of MIMO systems based on simultaneous perturbation stochastic approximation [J].

Ahmad, Mohd Ashraf ;

Azuma, Shun-ichi ;

Sugie, Toshiharu .

EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (14) :6361-6370

[36] Eddy Current Probe Parameters Identification Using a Genetic Algorithm and Simultaneous Perturbation Stochastic Approximation [J].

Chaiba, Sid Ahmed ;

Ayad, Abdelghani ;

Ziani, Djamel ;

Le Bihan, Yann ;

Javier Garcia, Martin .

JOURNAL OF NONDESTRUCTIVE EVALUATION, 2018, 37 (03)

[37] Parameter estimation in a highly non-linear model using simultaneous perturbation stochastic approximation [J].

Whitney, JE ;

Duncan, K ;

Richardson, M ;

Bankman, I .

COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2000, 29 (5-6) :1247-1256

[38] IMPROVED TOOL POSITIONING IN 5-AXIS FLANK MILLING BY SIMULTANEOUS PERTURBATION STOCHASTIC APPROXIMATION [J].

Chu, Chih-Hsing ;

Wu, Ping-Han ;

Hsieh, Hsin-Ta .

INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2012, 8 (5A) :3265-3278

[39] Randomized Stochastic Approximation Algorithms [J].

Amelin, Konstantin ;

Granichin, Oleg ;

Granichina, Olga .

2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, :2827-2832

[40] Using normalized simultaneous perturbation stochastic approximation for stable convergence in model-free control scheme [J].

Ahmad, Mohd Ashraf ;

Mustapha, Nik Mohd Zaitul Akmal ;

Nasir, Ahmad Nor Kasruddin ;

Tumari, Mohd Zaidi Mohd ;

Ismail, Raja Mohd Taufika Raja ;

Ibrahim, Zuwairie .

PROCEEDINGS OF 4TH IEEE INTERNATIONAL CONFERENCE ON APPLIED SYSTEM INNOVATION 2018 ( IEEE ICASI 2018 ), 2018, :935-938

← 1 2 3 4 5 →