Reinforcement learning for HVAC control and energy efficiency in residential buildings with BOPTEST simulations and real-case validation

被引:1
作者
Boutahri, Youssef [1 ]
Tilioua, Amine [1 ]
机构
[1] Moulay Ismail Univ Meknes, Fac Sci & Tech Errachidia, Dept Engn Sci, Mech Eergy Efficiency & Renewable Energies Lab LM3, BP 509, Errachidia, Morocco
关键词
HVAC systems; Energy efficiency in buildings; Reinforcement learning; Building optimization testing; PI controllers; CONTROL-SYSTEMS; FRAMEWORK; OPTIMIZATION; MANAGEMENT;
D O I
10.1007/s10791-025-09544-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing emphasis on comfortable indoor environments, coupled with the challenges posed by climate change, demands innovative strategies for heating, ventilation, and air conditioning (HVAC) control. This paper proposes a Reinforcement Learning (RL)-based approach that not only enhances occupant comfort but also maximizes energy efficiency, thereby contributing to reduced greenhouse gas emissions. Leveraging the Building Optimization Testing (BOPTEST) platform for systematic validation, our methodology addresses the inherent complexity of indoor climates and building thermal dynamics. Simulation results show that the RL agent achieves up to 26.3% energy savings over a specified period, outperforming conventional Proportional-Integral (PI) controllers. Beyond simulation, an experimental case study was conducted in a residential building located in Mekn & egrave;s, Morocco, confirming the agent's adaptability under real-world conditions. Despite the shorter testing window, these trials demonstrated a further 8.8% reduction in energy consumption compared to a basic rule-based controller, reinforcing the RL agent's ability to balance thermal comfort and operational efficiency. By bridging this critical gap in HVAC control research, our work offers a transformative, data-driven strategy for achieving both sustainability and occupant well-being in residential buildings.
引用
收藏
页数:26
相关论文
共 43 条
[1]   Application of deep Q-networks for model-free optimal control balancing between different HVAC systems [J].
Ahn, Ki Uhn ;
Park, Cheol Soo .
SCIENCE AND TECHNOLOGY FOR THE BUILT ENVIRONMENT, 2020, 26 (01) :61-74
[2]  
AMEE, Agence Marocaine de l'Efficacite Energetique
[3]  
[Anonymous], 2021, 2015 recs square footage methodology
[4]  
[Anonymous], 2011, Energy Efficiency Trends in Canada 1990 to 2009
[5]   An OpenAI-Gym environment for the Building Optimization Testing (BOPTEST) framework [J].
Arroyo, Javier ;
Manna, Carlo ;
Spiessens, Fred ;
Helsen, Lieve .
PROCEEDINGS OF BUILDING SIMULATION 2021: 17TH CONFERENCE OF IBPSA, 2022, 17 :175-182
[6]  
Ashrae G., 2018, 36: High performance sequences of operation for HVAC systems
[7]   Building Automation and Control Systems and performance optimization: A framework for analysis [J].
Aste, Niccolo ;
Manfren, Massimiliano ;
Marenzi, Giorgia .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2017, 75 :313-330
[8]   A new adaptive PI controller and its application in HVAC systems [J].
Bai, Jianbo ;
Zhang, Xiaosong .
ENERGY CONVERSION AND MANAGEMENT, 2007, 48 (04) :1043-1054
[9]  
Blochwitz T., 2012, P 9 INT MOD C SEPT M, P173, DOI DOI 10.3384/ECP12076173
[10]   Building optimization testing framework (BOPTEST) for simulation-based benchmarking of control strategies in buildings [J].
Blum, David ;
Arroyo, Javier ;
Huang, Sen ;
Drgona, Jan ;
Jorissen, Filip ;
Walnum, Harald Taxt ;
Chen, Yan ;
Benne, Kyle ;
Vrabie, Draguna ;
Wetter, Michael ;
Helsen, Lieve .
JOURNAL OF BUILDING PERFORMANCE SIMULATION, 2021, 14 (05) :586-610