Research on overall energy consumption optimization method for data center based on deep reinforcement learning

被引:1
|
作者
Wang Simin [1 ,2 ]
Qin Lulu [1 ]
Ma Chunmiao [1 ]
Wu Weiguo [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] Xian Polytech Univ, Xian, Peoples R China
关键词
Energy consumption; data center; job scheduling; cooling system; deep reinforcement learning; multi-agent system; DVFS;
D O I
10.3233/JIFS-223769
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of cloud computing, there are more and more large-scale data centers, which makes the energy management of data centers more complex. In order to achieve better energy-saving effect, it is necessary to solve the problems of concurrent management and interdependence of IT, refrigeration, storage, and network equipment. Reinforcement learning learns by interacting with the environment, which is a good way to realize the independent management of the data center. In this paper, a overall energy consumption method for data center based on deep reinforcement learning is proposed to achieve collaborative energy saving of data center task scheduling and refrigeration equipment. A new multi-agent architecture is proposed to separate the training process from the execution process, simplify the interaction process during system operation and improve the operation effect. In the deep learning stage, a hybrid deep Q network algorithm is proposed to optimize the joint action value function of the data center and obtain the optimal strategy. Experiments show that compared with other reinforcement learning methods, our method can not only reduce the energy consumption of the data center, but also reduce the frequency of hot spots.
引用
收藏
页码:7333 / 7349
页数:17
相关论文
共 50 条
  • [1] Method for evaluation on energy consumption of cloud computing data center based on deep reinforcement learning
    Ma, Haizhou
    Ding, Aiping
    ELECTRIC POWER SYSTEMS RESEARCH, 2022, 208
  • [2] Deep Reinforcement Learning based Optimization of Battery Charging and Discharging Management for Data Center
    Yan, Longchuan
    Liu, Wantao
    Jiang, Wei
    Li, Yan
    Li, Ruixuan
    Hui, Songlin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Cooperatively Improving Data Center Energy Efficiency Based on Multi-Agent Deep Reinforcement Learning
    Chi, Ce
    Ji, Kaixuan
    Song, Penglei
    Marahatta, Avinab
    Zhang, Shikui
    Zhang, Fa
    Qiu, Dehui
    Liu, Zhiyong
    ENERGIES, 2021, 14 (08)
  • [4] Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning
    Peng, Yi
    Shen, Haojun
    Tang, Xiaochang
    Zhang, Sizhe
    Zhao, Jinxiao
    Liu, Yuru
    Nie, Yuming
    IEEE ACCESS, 2023, 11 : 88265 - 88277
  • [5] DeepEE: Joint Optimization of Job Scheduling and Cooling Control for Data Center Energy Efficiency Using Deep Reinforcement Learning
    Ran, Yongyi
    Hu, Han
    Zhou, Xin
    Wen, Yonggang
    2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, : 645 - 655
  • [6] Reinforcement learning for data center energy efficiency optimization: A systematic literature review and research roadmap
    Kahil, Hussain
    Sharma, Shiva
    Vaelisuo, Petri
    Elmusrati, Mohammed
    APPLIED ENERGY, 2025, 389
  • [7] Deep reinforcement learning based optimization of automated guided vehicle time and energy consumption in a container terminal
    Drungilas, Darius
    Kurmis, Mindaugas
    Senulis, Audrius
    Lukosius, Zydrunas
    Andziulis, Arunas
    Januteniene, Jolanta
    Bogdevicius, Marijonas
    Jankunas, Valdas
    Voznak, Miroslav
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 67 : 397 - 407
  • [8] Optimizing Energy Efficiency for Data Center via Parameterized Deep Reinforcement Learning
    Ran, Yongyi
    Hu, Han
    Wen, Yonggang
    Zhou, Xin
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (02) : 1310 - 1323
  • [9] Deep Reinforcement Learning-Based Routing Optimization Algorithm for Edge Data Center
    Zhao, Jixin
    Zhang, Shukui
    Zhang, Yang
    Zhang, Li
    Long, Hao
    26TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2021), 2021,
  • [10] Towards an energy-efficient Data Center Network based on deep reinforcement learning
    Wang, Yang
    Li, Yutong
    Wang, Ting
    Liu, Gang
    COMPUTER NETWORKS, 2022, 210