Research on overall energy consumption optimization method for data center based on deep reinforcement learning

被引:1
|
作者
Wang Simin [1 ,2 ]
Qin Lulu [1 ]
Ma Chunmiao [1 ]
Wu Weiguo [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] Xian Polytech Univ, Xian, Peoples R China
关键词
Energy consumption; data center; job scheduling; cooling system; deep reinforcement learning; multi-agent system; DVFS;
D O I
10.3233/JIFS-223769
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of cloud computing, there are more and more large-scale data centers, which makes the energy management of data centers more complex. In order to achieve better energy-saving effect, it is necessary to solve the problems of concurrent management and interdependence of IT, refrigeration, storage, and network equipment. Reinforcement learning learns by interacting with the environment, which is a good way to realize the independent management of the data center. In this paper, a overall energy consumption method for data center based on deep reinforcement learning is proposed to achieve collaborative energy saving of data center task scheduling and refrigeration equipment. A new multi-agent architecture is proposed to separate the training process from the execution process, simplify the interaction process during system operation and improve the operation effect. In the deep learning stage, a hybrid deep Q network algorithm is proposed to optimize the joint action value function of the data center and obtain the optimal strategy. Experiments show that compared with other reinforcement learning methods, our method can not only reduce the energy consumption of the data center, but also reduce the frequency of hot spots.
引用
收藏
页码:7333 / 7349
页数:17
相关论文
共 50 条
  • [31] Data Center Selection Based on Reinforcement Learning
    Li, Qirui
    Peng, Zhiping
    Cui, Denglong
    He, Jieguang
    Chen, Ke
    Zhou, Jing
    PROCEEDINGS OF 2019 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT 2019), 2019, : 14 - 19
  • [32] An Optimization Method for Offshore Platform HVAC Systems Based on Deep Reinforcement Learning
    Xue, Jiahui
    Liu, Yuntao
    Cui, Can
    PROCEEDINGS OF THE 2024 3RD INTERNATIONAL SYMPOSIUM ON INTELLIGENT UNMANNED SYSTEMS AND ARTIFICIAL INTELLIGENCE, SIUSAI 2024, 2024, : 325 - 329
  • [33] A Deep Reinforcement Learning Model-Based Optimization Method for Graphic Design
    Guo Q.
    Wang Z.
    Informatica (Slovenia), 2024, 48 (05): : 121 - 134
  • [34] Optimizing Data Center Energy Efficiency via Event-Driven Deep Reinforcement Learning
    Ran, Yongyi
    Zhou, Xin
    Hu, Han
    Wen, Yonggang
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (02) : 1296 - 1309
  • [35] Energy Consumption Modeling and Optimization of UAV-Assisted MEC Networks Using Deep Reinforcement Learning
    Yan, Ming
    Zhang, Litong
    Jiang, Wei
    Chan, Chien Aun
    Gygax, Andre F.
    Nirmalathas, Ampalavanapillai
    IEEE SENSORS JOURNAL, 2024, 24 (08) : 13629 - 13639
  • [36] DeepRLB: A deep reinforcement learning-based load balancing in data center networks
    Rikhtegar, Negar
    Bushehrian, Omid
    Keshtgari, Manijeh
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2021, 34 (15)
  • [37] Deep Reinforcement Learning-Based Energy Consumption Optimization for Peer-to-Peer (P2P) Communication in Wireless Sensor Networks
    Yuan, Jinyu
    Peng, Jingyi
    Yan, Qing
    He, Gang
    Xiang, Honglin
    Liu, Zili
    SENSORS, 2024, 24 (05)
  • [38] RESEARCH ON HEV ENERGY MANAGEMENT STRATEGY BASED ON IMPROVED DEEP REINFORCEMENT LEARNING
    Wu, Zhongqiang
    Ma, Boyan
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (12) : 8451 - 8468
  • [39] Research on ATO Control Method for Urban Rail Based on Deep Reinforcement Learning
    Chen, Xiaoqiang
    Guo, Xiao
    Meng, Jianjun
    Xu, Ruxun
    Li, Shanshan
    Li, Decang
    IEEE ACCESS, 2023, 11 : 5919 - 5928
  • [40] A novel milling parameter optimization method based on improved deep reinforcement learning considering machining cost
    Li, Weiye
    Li, Bin
    He, Songping
    Mao, Xinyong
    Qiu, Chaochao
    Qiu, Yue
    Tan, Xin
    JOURNAL OF MANUFACTURING PROCESSES, 2022, 84 : 1362 - 1375