Research on overall energy consumption optimization method for data center based on deep reinforcement learning

被引:1
作者
Wang Simin [1 ,2 ]
Qin Lulu [1 ]
Ma Chunmiao [1 ]
Wu Weiguo [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] Xian Polytech Univ, Xian, Peoples R China
关键词
Energy consumption; data center; job scheduling; cooling system; deep reinforcement learning; multi-agent system; DVFS;
D O I
10.3233/JIFS-223769
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of cloud computing, there are more and more large-scale data centers, which makes the energy management of data centers more complex. In order to achieve better energy-saving effect, it is necessary to solve the problems of concurrent management and interdependence of IT, refrigeration, storage, and network equipment. Reinforcement learning learns by interacting with the environment, which is a good way to realize the independent management of the data center. In this paper, a overall energy consumption method for data center based on deep reinforcement learning is proposed to achieve collaborative energy saving of data center task scheduling and refrigeration equipment. A new multi-agent architecture is proposed to separate the training process from the execution process, simplify the interaction process during system operation and improve the operation effect. In the deep learning stage, a hybrid deep Q network algorithm is proposed to optimize the joint action value function of the data center and obtain the optimal strategy. Experiments show that compared with other reinforcement learning methods, our method can not only reduce the energy consumption of the data center, but also reduce the frequency of hot spots.
引用
收藏
页码:7333 / 7349
页数:17
相关论文
共 50 条
  • [41] Research on big data personalised recommendation model based on deep reinforcement learning
    Shi H.
    Shang L.
    International Journal of Networking and Virtual Organisations, 2023, 28 (2-4) : 364 - 380
  • [42] Cloud Task Scheduling Based on Proximal Policy Optimization Algorithm for Lowering Energy Consumption of Data Center
    Yang, Yongquan
    He, Cuihua
    Yin, Bo
    Wei, Zhiqiang
    Hong, Bowei
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (06): : 1877 - 1891
  • [43] RIS-Assisted Energy-Efficient UAV Data Collection Method Based on Deep Reinforcement Learning
    Dong, Lu
    Lu, Mengjiao
    Wu, Yang
    Li, Xiaomeng
    Wu, Yongbao
    Yuan, Xin
    MOBILE NETWORKS & APPLICATIONS, 2025,
  • [44] Study on deep reinforcement learning techniques for building energy consumption forecasting
    Liu, Tao
    Tan, Zehan
    Xu, Chengliang
    Chen, Huanxin
    Li, Zhengfei
    ENERGY AND BUILDINGS, 2020, 208
  • [45] Research on Distribution Network Topology Control Based on Deep Reinforcement Learning Combinatorial Optimization
    Yan D.
    Peng G.
    Gao H.
    Chen S.
    Zhou Y.
    Dianwang Jishu/Power System Technology, 2022, 46 (07): : 2547 - 2554
  • [46] Research on Intelligent Signal Timing Optimization of Signalized Intersection Based on Deep Reinforcement Learning Using Floating Car Data
    Chen, Deqi
    Xu, Tiandong
    Ma, Siwei
    Gao, Xixin
    Zhao, Guiguo
    TRANSPORTATION RESEARCH RECORD, 2024, 2678 (12) : 1126 - 1147
  • [47] Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach
    Abedin, Sarder Fakhrul
    Munir, Md Shirajum
    Tran, Nguyen H.
    Han, Zhu
    Hong, Choong Seon
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (09) : 5994 - 6006
  • [48] Deep Reinforcement Learning-based Energy Efficiency Optimization For Flying LoRa Gateways
    Jouhari, Mohammed
    Ibrahimi, Khalil
    Ben Othman, Jalel
    Amhoud, El Mehdi
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 6157 - 6162
  • [49] Data center energy consumption prediction model based on deep neural network BiLSTM
    Zhou, Junqiang
    Wang, Yan
    Li, JieFeng
    2024 IEEE 48TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC 2024, 2024, : 737 - 745
  • [50] Deep Reinforcement Learning for Energy Efficiency Optimization in Wireless Networks
    Fan, Haoren
    Zhu, Lei
    Yao, Changhua
    Guo, Jibin
    Lu, Xiaowen
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2019, : 465 - 471