A reinforcement learning-based temperature control of fluidized bed reactor in gas-phase polyethylene process

被引:3
作者
Hong, Xiaodong [1 ,2 ]
Shou, Zhoupeng [1 ]
Chen, Wanke [1 ]
Liao, Zuwei [1 ]
Sun, Jingyuan [1 ]
Yang, Yao [1 ]
Wang, Jingdai [1 ]
Yang, Yongrong [1 ]
机构
[1] Zhejiang Univ, Coll Chem & Biol Engn, State Key Lab Chem Engn, Hangzhou 310027, Peoples R China
[2] ZJU Hangzhou Global Sci & Technol Innovat Ctr, Engn Res Ctr Funct Mat Intelligent Mfg Zhejiang Pr, Hangzhou 311215, Peoples R China
基金
中国国家自然科学基金;
关键词
Temperature control; Deep reinforcement learning; Cascade control; Gas -phase polyethylene process; POLYMERIZATION; SYSTEM; MODEL;
D O I
10.1016/j.compchemeng.2024.108588
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study investigates using deep reinforcement learning (DRL) with proportional-integral-derivative (PID) control for temperature cascade control in a fluidized bed reactor within a commercial gas-phase polyethylene process. The heat exchange system's nonlinearity and frequent disturbances pose challenges for PID controllers, particularly under varying conditions. To address this, a PID-DRL cascade control scheme is developed, where a DRL controller is used in the secondary loop. The DRL controller, designed using the actor-critic framework, is trained using the Deep Deterministic Policy Gradient algorithm. The DRL controller is evaluated in three standalone secondary loop experiments, as well as three cascade control experiments. Results reveal the DRL controller surpass the traditional PID controller in both scenarios. The DRL controller shows better set point tracking and interference suppression, indicated by lower integral absolute error (IAE) values. The proposed cascade control structure can be used to enhance reactor stability and product quality in gas-phase polyethylene processes.
引用
收藏
页数:12
相关论文
共 30 条
  • [1] Dynamic process modeling and hybrid intelligent control of ethylene copolymerization in gas phase catalytic fluidized bed reactors
    Abbasi, Mohammad Reza
    Shamiri, Ahmad
    Hussain, Mohamed Azlan
    Kaboli, Seyed Hamidreza Aghay
    [J]. JOURNAL OF CHEMICAL TECHNOLOGY AND BIOTECHNOLOGY, 2019, 94 (08) : 2433 - 2451
  • [2] A reinforcement learning-based economic model predictive control framework for autonomous operation of chemical reactors
    Alhazmi, Khalid
    Albalawi, Fahad
    Sarathy, S. Mani
    [J]. CHEMICAL ENGINEERING JOURNAL, 2022, 428
  • [3] Deep reinforcement learning control of hydraulic fracturing
    Bangi, Mohammed Saad Faizan
    Kwon, Joseph Sang-Il
    [J]. COMPUTERS & CHEMICAL ENGINEERING, 2021, 154
  • [4] A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control
    Bao, Yaoyao
    Zhu, Yuanming
    Qian, Feng
    [J]. INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2021, 60 (15) : 5504 - 5515
  • [5] [陈皓炜 Chen Haowei], 2022, [动力工程学报, Journal of Chinese Society of Power Engineering], V42, P421
  • [6] Tuning Strategies for Overcoming Fouling Effects in Proportional Integral Derivative Controlled Heat Exchangers
    de Carvalho, Carolina Borges
    Carvalho, Esdras P.
    Ravagnani, Mauro A. S. S.
    [J]. INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2018, 57 (31) : 10518 - 10527
  • [7] Online reinforcement learning for a continuous space system with experimental validation
    Dogru, Oguzhan
    Wieczorek, Nathan
    Velswamy, Kirubakaran
    Ibrahim, Fadi
    Huang, Biao
    [J]. JOURNAL OF PROCESS CONTROL, 2021, 104 (104) : 86 - 100
  • [8] A survey and comparative evaluation of actor-critic methods in process control
    Dutta, Debaprasad
    Upreti, Simant R.
    [J]. CANADIAN JOURNAL OF CHEMICAL ENGINEERING, 2022, 100 (09) : 2028 - 2056
  • [9] Thermal-Stability Analysis of Ethylene-Polymerization Fluidized-Bed Reactors under Condensed-Mode Operation through a TPM-PBM Integrated Model
    Fan, Xiaoqiang
    Sun, Jingyuan
    Yang, Yao
    Wang, Jingdai
    Huang, Zhengliang
    Liao, Zuwei
    Han, Guodong
    Yang, Yongrong
    Xie, Lei
    Su, Hongye
    [J]. INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2019, 58 (22) : 9486 - 9499
  • [10] Stability Analysis of Ethylene Polymerization in a Liquid-Containing Gas-Solid Fluidized Bed Reactor
    Fan, Xiaoqiang
    Sun, Jingyuan
    Wang, Jingdai
    Huang, Zhengliang
    Liao, Zuwei
    Han, Guodong
    Yang, Yongrong
    Xie, Lei
    Su, Hongye
    [J]. INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2018, 57 (16) : 5616 - 5629