Research on overall energy consumption optimization method for data center based on deep reinforcement learning

被引:1
|
作者
Wang Simin [1 ,2 ]
Qin Lulu [1 ]
Ma Chunmiao [1 ]
Wu Weiguo [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] Xian Polytech Univ, Xian, Peoples R China
关键词
Energy consumption; data center; job scheduling; cooling system; deep reinforcement learning; multi-agent system; DVFS;
D O I
10.3233/JIFS-223769
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of cloud computing, there are more and more large-scale data centers, which makes the energy management of data centers more complex. In order to achieve better energy-saving effect, it is necessary to solve the problems of concurrent management and interdependence of IT, refrigeration, storage, and network equipment. Reinforcement learning learns by interacting with the environment, which is a good way to realize the independent management of the data center. In this paper, a overall energy consumption method for data center based on deep reinforcement learning is proposed to achieve collaborative energy saving of data center task scheduling and refrigeration equipment. A new multi-agent architecture is proposed to separate the training process from the execution process, simplify the interaction process during system operation and improve the operation effect. In the deep learning stage, a hybrid deep Q network algorithm is proposed to optimize the joint action value function of the data center and obtain the optimal strategy. Experiments show that compared with other reinforcement learning methods, our method can not only reduce the energy consumption of the data center, but also reduce the frequency of hot spots.
引用
收藏
页码:7333 / 7349
页数:17
相关论文
共 50 条
  • [11] Pig Building Environment Optimization Control and Energy Consumption Analysis Based on Deep Reinforcement Learning
    Xie Q.
    Wang S.
    Musabimana J.
    Guo Y.
    Liu H.
    Bao J.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (11): : 376 - 430
  • [12] DeepJS']JS: Job Scheduling Based on Deep Reinforcement Learning in Cloud Data Center
    Li, Fengcun
    Hu, Bo
    ICBDC 2019: PROCEEDINGS OF 2019 4TH INTERNATIONAL CONFERENCE ON BIG DATA AND COMPUTING, 2019, : 48 - 53
  • [13] Joint Optimization of Age of Information and Energy Consumption in NR-V2X System Based on Deep Reinforcement Learning
    Song, Shulin
    Zhang, Zheng
    Wu, Qiong
    Fan, Pingyi
    Fan, Qiang
    SENSORS, 2024, 24 (13)
  • [14] Deep Reinforcement Learning Based Double-layer Optimization Method for Energy Management of Microgrid
    Yu, Qinglei
    Xu, Wei
    Lv, Jianhu
    Wang, Ying
    Zhang, Kaifeng
    2023 5TH ASIA ENERGY AND ELECTRICAL ENGINEERING SYMPOSIUM, AEEES, 2023, : 1016 - 1022
  • [15] RESEARCH ON SUPPLY CHAIN OPTIMIZATION AND MANAGEMENT BASED ON DEEP REINFORCEMENT LEARNING
    Gao, Yunxiang
    Wang, Zhao
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (06): : 4814 - 4824
  • [16] Optimization Strategy Based on Deep Reinforcement Learning for Home Energy Management
    Liu, Yuankun
    Zhang, Dongxia
    Gooi, Hoay Beng
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (03): : 572 - 582
  • [17] Multi-energy Collaborative Optimization Method for Distributed Energy Systems Based on Hierarchical Deep Reinforcement Learning
    Wang L.
    Hu G.
    Wu H.
    Tan K.
    Zhou C.
    Zhu Y.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2024, 48 (01): : 67 - 76
  • [18] Energy Efficiency Optimization in Heterogeneous Networks Based on Deep Reinforcement Learning
    Shi, Daoping
    Tian, Feng
    Wu, Shengchen
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [19] Optimization on air distribution and energy consumption of a small data center
    Zhang, Jie
    Zhou, Hao
    Feng, Zhuangbo
    Sun, Chao
    Jin, Zhou
    Long, Zhengwei
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2014, 47 (07): : 647 - 652
  • [20] Prediction Method of Energy Consumption Based on Multiple Energy-related Features in Data Center
    Liang, Yang
    Hu, Zhigang
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 140 - 146