Active structural control framework using policy-gradient reinforcement learning

被引:22
作者
Eshkevari, Soheila Sadeghi [1 ]
Eshkevari, Soheil Sadeghi [2 ]
Sen, Debarshi [1 ,3 ]
Pakzad, Shamim N. [1 ]
机构
[1] Lehigh Univ, Dept Civil & Environm Engn, Bethlehem, PA 18015 USA
[2] MIT, Senseable City Lab, Cambridge, MA USA
[3] Southern Illinois Univ, Sch Civil Environm & Infrastruct Engn, Carbondale, IL USA
关键词
Active control; Reinforcement learning; Policy-gradient methods; Nonlinear dynamics; BASE-ISOLATION SYSTEMS; OF-THE-ART; SEMIACTIVE CONTROL; VIBRATION CONTROL; SEISMIC PROTECTION; NEGATIVE STIFFNESS; RESPONSE CONTROL; FEEDBACK-CONTROL; MASS DAMPER; MR DAMPERS;
D O I
10.1016/j.engstruct.2022.115122
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper presents a novel data-driven approach for active structural control through the use of deep reinforcement learning, wherein, the control system learns to react in an optimal manner through a training process that utilizes deep neural networks within a reinforcement learning framework. The key advantage of this paradigm is the data-driven approach to active control which helps circumvent the need for high-fidelity modeling that typically requires extensive prior knowledge about the structure of interest. Furthermore, the proposed framework is applicable for designing a variety of active controllers, and different external load types, for example, wind and seismic loads for any desired building. The efficacy of the proposed framework is demonstrated in the context of seismic response control through three numerical case studies. The results confirm that the proposed approach yields significant structural response reductions in the linear and nonlinear regimes. Furthermore, implementation issues such as sensitivity to structural property variations, and time delay are thoroughly investigated.
引用
收藏
页数:15
相关论文
共 86 条
[1]   Reinforcement learning for structural control [J].
Adam, Bernard ;
Smith, Ian F. C. .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2008, 22 (02) :133-139
[2]   Wavelet PSO-Based LQR Algorithm for Optimal Structural Control Using Active Tuned Mass Dampers [J].
Amini, Fereidoun ;
Hazaveh, N. Khanmohammadi ;
Rad, A. Abdolahi .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2013, 28 (07) :542-557
[3]  
[Anonymous], 2018, P 2 C ROB LEARN
[4]  
Balas M. J., 1979, Journal of Guidance and Control, V2, P252, DOI 10.2514/3.55869
[5]   Applied active control for a nonlinear aeroelastic structure [J].
Block, JJ ;
Strganac, TW .
JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 1998, 21 (06) :838-845
[6]  
Buckle I.G., 1990, Earthquake Spectra, V6, P161, DOI [10.1193/1.1585564, DOI 10.1193/1.1585564]
[7]   Reinforcement learning for control: Performance, stability, and deep approximators [J].
Busoniu, Lucian ;
de Bruin, Tim ;
Tolic, Domagoj ;
Kober, Jens ;
Palunko, Ivana .
ANNUAL REVIEWS IN CONTROL, 2018, 46 :8-28
[8]   Assessment and dynamic nonlinear analysis of different base isolation systems for a multi-storey RC building irregular in plan [J].
Cancellara, Donato ;
De Angelis, Fabio .
COMPUTERS & STRUCTURES, 2017, 180 :74-88
[9]   Design of an active mass damper for a tall TV tower in Nanjing, China [J].
Cao, H ;
Reinhorn, AM ;
Soong, TT .
ENGINEERING STRUCTURES, 1998, 20 (03) :134-143
[10]   Active and semi-active control of structures - theory and applications: A review of recent advances [J].
Casciati, Fabio ;
Rodellar, Jose ;
Yildirim, Umut .
JOURNAL OF INTELLIGENT MATERIAL SYSTEMS AND STRUCTURES, 2012, 23 (11) :1181-1195