A reinforcement learning-based temperature control of fluidized bed reactor in gas-phase polyethylene process

被引:3
作者
Hong, Xiaodong [1 ,2 ]
Shou, Zhoupeng [1 ]
Chen, Wanke [1 ]
Liao, Zuwei [1 ]
Sun, Jingyuan [1 ]
Yang, Yao [1 ]
Wang, Jingdai [1 ]
Yang, Yongrong [1 ]
机构
[1] Zhejiang Univ, Coll Chem & Biol Engn, State Key Lab Chem Engn, Hangzhou 310027, Peoples R China
[2] ZJU Hangzhou Global Sci & Technol Innovat Ctr, Engn Res Ctr Funct Mat Intelligent Mfg Zhejiang Pr, Hangzhou 311215, Peoples R China
基金
中国国家自然科学基金;
关键词
Temperature control; Deep reinforcement learning; Cascade control; Gas -phase polyethylene process; POLYMERIZATION; SYSTEM; MODEL;
D O I
10.1016/j.compchemeng.2024.108588
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates using deep reinforcement learning (DRL) with proportional-integral-derivative (PID) control for temperature cascade control in a fluidized bed reactor within a commercial gas-phase polyethylene process. The heat exchange system's nonlinearity and frequent disturbances pose challenges for PID controllers, particularly under varying conditions. To address this, a PID-DRL cascade control scheme is developed, where a DRL controller is used in the secondary loop. The DRL controller, designed using the actor-critic framework, is trained using the Deep Deterministic Policy Gradient algorithm. The DRL controller is evaluated in three standalone secondary loop experiments, as well as three cascade control experiments. Results reveal the DRL controller surpass the traditional PID controller in both scenarios. The DRL controller shows better set point tracking and interference suppression, indicated by lower integral absolute error (IAE) values. The proposed cascade control structure can be used to enhance reactor stability and product quality in gas-phase polyethylene processes.
引用
收藏
页数:12
相关论文
共 30 条
  • [11] Autonomous pH control by reinforcement learning for electroplating industry wastewater
    Goulart, Douglas Alves
    Pereira, Renato Dutra
    [J]. COMPUTERS & CHEMICAL ENGINEERING, 2020, 140 (140)
  • [12] A neural network assisted cascade control system for air handling unit
    Guo, Chengyi
    Song, Qing
    Cai, Wenjian
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2007, 54 (01) : 620 - 628
  • [13] Control of industrial gas phase propylene polymerization in fluidized bed reactors
    Ho, Yong Kuen
    Shamiri, Ahmad
    Mjalli, Farouq S.
    Hussain, M. A.
    [J]. JOURNAL OF PROCESS CONTROL, 2012, 22 (06) : 947 - 958
  • [14] Mathematical model and advanced control for gas-phase olefin polymerization in fluidized-bed catalytic reactors
    Ibrehem, Ahmmed S.
    Hussain, Mohamed Azian
    Ghasem, Nayef M.
    [J]. CHINESE JOURNAL OF CHEMICAL ENGINEERING, 2008, 16 (01) : 84 - 89
  • [15] Safe model-based reinforcement learning for nonlinear optimal control with state and input constraints
    Kim, Yeonsoo
    Kim, Jong Woo
    [J]. AICHE JOURNAL, 2022, 68 (05)
  • [16] Model-based reinforcement learning for nonlinear optimal control with practical asymptotic stability guarantees
    Kim, Yeonsoo
    Lee, Jong Min
    [J]. AICHE JOURNAL, 2020, 66 (10)
  • [17] Lillicrap T.P., 2015, arXiv
  • [18] Heat-Exchanger Bypass Control
    Luyben, William L.
    [J]. INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2011, 50 (02) : 965 - 973
  • [19] Continuous control of a polymerization system with deep reinforcement learning
    Ma, Yan
    Zhu, Wenbo
    Benton, Michael G.
    Romagnoli, Jose
    [J]. JOURNAL OF PROCESS CONTROL, 2019, 75 : 40 - 47
  • [20] Control of a nonlinear liquid level system using a new artificial neural network based reinforcement learning approach
    Noel, Mattew Mithra
    Pandian, B. Jaganatha
    [J]. APPLIED SOFT COMPUTING, 2014, 23 : 444 - 451