Joint energy optimization on the server and network sides for geo-distributed data centers

被引:7
作者
Qin, Yang [1 ]
Han, Wuji [1 ]
Yang, Yuanyuan [2 ]
Yang, Weihong [1 ]
机构
[1] Harbin Inst Technol Shenzhen, Dept Comp Sci, Shenzhen, Peoples R China
[2] SUNY Stony Brook, Dept Comp Sci, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
关键词
Geo-distributed data centers; Energy optimization; Geographical load balancing; Online control;
D O I
10.1007/s11227-020-03523-4
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy optimization has become an emerging concern for cloud service providers. Existing methods focus on reducing the energy consumption of either server inside the data center or data transmission between data centers. Moreover, most of the works are based on assumptions that servers and workloads are homogeneous. This is not in accordance with the fact that modern data centers are built from various classes of servers. In this paper, we consider the joint energy optimization of intra- and inter-data center in both homo- and heterogeneous cases. We first propose an optimization model to minimize the joint energy cost of servers and network sides. To tackle the time-coupling constraint of carbon emission, we apply the Lyapunov optimization framework to transform the original problem into a well-studied queue stability problem. For better scalability of time complexity, we derive a distributed solution by using generalized benders decomposition. Then, we extend the model to deal with the situation where requests and data centers are heterogeneous as data centers are typically built from servers with different specifications. To better deal with the dynamic of the network (e.g., the occurrence of faults), we leverage a deep Q-network (DQN) and propose a fault-tolerant DQN-based solution. Finally, the simulation results show the high efficiency of our proposal in cost-saving and performance-enhancing.
引用
收藏
页码:7757 / 7790
页数:34
相关论文
共 44 条
[11]   A General Communication Cost Optimization Framework for Big Data Stream Processing in Geo-Distributed Data Centers [J].
Gu, Lin ;
Zeng, Deze ;
Guo, Song ;
Xiang, Yong ;
Hu, Jiankun .
IEEE TRANSACTIONS ON COMPUTERS, 2016, 65 (01) :19-29
[12]   Electricity Cost Saving Strategy in Data Centers by Using Energy Storage [J].
Guo, Yuanxiong ;
Fang, Yuguang .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2013, 24 (06) :1149-1160
[13]   Customer Satisfaction-aware Scheduling for Utility Maximization on Geo-distributed Cloud Data Centers [J].
Jing, Chao ;
Zhu, Yanmin ;
Li, Minglu .
2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, :218-225
[14]   Deep Learning-Based Sustainable Data Center Energy Cost Minimization With Temporal MACRO/MICRO Scale Management [J].
Kang, Dong-Ki ;
Yang, Eun-Ju ;
Youn, Chan-Hyun .
IEEE ACCESS, 2019, 7 :5477-5491
[15]  
Kulkami AK, 2017, 2017 IEEE INT C SIGN, P1, DOI [10.1109/SPICES.2017.8091337, DOI 10.1109/SPICES.2017.8091337]
[16]  
Li W, 2019, IEEE T CLOUD COMPUT, V7, P12
[17]   Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning [J].
Li, Yuanlong ;
Wen, Yonggang ;
Tao, Dacheng ;
Guan, Kyle .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (05) :2002-2013
[18]   Dynamic Right-Sizing for Power-Proportional Data Centers [J].
Lin, Minghong ;
Wierman, Adam ;
Andrew, Lachlan L. H. ;
Thereska, Eno .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2013, 21 (05) :1378-1391
[19]   Greening Geographical Load Balancing [J].
Liu, Zhenhua ;
Lin, Minghong ;
Wierman, Adam ;
Low, Steven ;
Andrew, Lachlan L. H. .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2015, 23 (02) :657-671
[20]   Bulk Savings for Bulk Transfers: Minimizing the Energy-Cost for Geo-Distributed Data Centers [J].
Lu, Xingjian ;
Kong, Fanxin ;
Liu, Xue ;
Yin, Jianwei ;
Xiang, Qiao ;
Yu, Huiqun .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2020, 8 (01) :73-85