Towards optimal control of air handling units using deep reinforcement learning and recurrent neural network

被引:116
作者
Zou, Zhengbo [1 ]
Yu, Xinran [1 ]
Ergan, Semiha [1 ]
机构
[1] NYU, Dept Civil & Urban Engn, MetroTech Ctr 15, Brooklyn, NY 11201 USA
关键词
HVAC control; Energy consumption; Thermal comfort; Deep reinforcement learning; Long-short-term-memory network; ENERGY-CONSUMPTION; BUILDINGS; SYSTEMS; COMFORT; MODELS;
D O I
10.1016/j.buildenv.2019.106535
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Optimal control of heating, ventilation and air conditioning systems (HVACs) aims to minimize the energy consumption of equipment while maintaining the thermal comfort of occupants. Traditional rule-based control methods are not optimized for HVAC systems with continuous sensor readings and actuator controls. Recent developments in deep reinforcement learning (DRL) enabled control of HVACs with continuous sensor inputs and actions, while eliminating the need of building complex thermodynamic models. DRL control includes an environment, which approximates real-world HVAC operations; and an agent, that aims to achieve optimal control over the HVAC. Existing DRL control frameworks use simulation tools (e.g., EnergyPlus) to build DRL training environments with HVAC systems information, but oversimplify building geometrics. This study proposes a framework aiming to achieve optimal control over Air Handling Units (AHUs) by implementing longshort-term-memory (LSTM) networks to approximate real-world HVAC operations to build DRL training environments. The framework also implements state-of-the-art DRL algorithms (e.g., deep deterministic policy gradient) for optimal control over the AHUs. Three AHUs, each with two-years of building automation system (BAS) data, were used as testbeds for evaluation. Our LSTM-based DRL training environments, built using the first year's BAS data, achieved an average mean square error of 0.0015 across 16 normalized AHU parameters. When deployed in the testing environments, which were built using the second year's BAS data of the same AHUs, the DRL agents achieved 27%-30% energy saving comparing to the actual energy consumption, while maintaining the predicted percentage of discomfort (PPD) at 10%.
引用
收藏
页数:15
相关论文
共 47 条
[1]   Theory and applications of HVAC control systems - A review of model predictive control (MPC) [J].
Afram, Abdul ;
Janabi-Sharifi, Farrokh .
BUILDING AND ENVIRONMENT, 2014, 72 :343-355
[2]  
[Anonymous], J PHYS THER
[3]  
[Anonymous], 2012, ANN EN REV 2011
[4]  
[Anonymous], 2016, C TRACK P
[5]  
[Anonymous], 2005, MANAGEMENT
[6]  
[Anonymous], 2014, Recurrent neural network regularization
[7]  
[Anonymous], 2011, INT J COMPUT THEORY
[8]  
[Anonymous], 1999, THERMAL DISTRIBUTION
[9]  
[Anonymous], 2014, 15 ANN C INT SPEECH
[10]  
[Anonymous], 1970, THERMAL COMFORT ANAL