Joint energy optimization on the server and network sides for geo-distributed data centers

被引:7
作者
Qin, Yang [1 ]
Han, Wuji [1 ]
Yang, Yuanyuan [2 ]
Yang, Weihong [1 ]
机构
[1] Harbin Inst Technol Shenzhen, Dept Comp Sci, Shenzhen, Peoples R China
[2] SUNY Stony Brook, Dept Comp Sci, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
关键词
Geo-distributed data centers; Energy optimization; Geographical load balancing; Online control;
D O I
10.1007/s11227-020-03523-4
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy optimization has become an emerging concern for cloud service providers. Existing methods focus on reducing the energy consumption of either server inside the data center or data transmission between data centers. Moreover, most of the works are based on assumptions that servers and workloads are homogeneous. This is not in accordance with the fact that modern data centers are built from various classes of servers. In this paper, we consider the joint energy optimization of intra- and inter-data center in both homo- and heterogeneous cases. We first propose an optimization model to minimize the joint energy cost of servers and network sides. To tackle the time-coupling constraint of carbon emission, we apply the Lyapunov optimization framework to transform the original problem into a well-studied queue stability problem. For better scalability of time complexity, we derive a distributed solution by using generalized benders decomposition. Then, we extend the model to deal with the situation where requests and data centers are heterogeneous as data centers are typically built from servers with different specifications. To better deal with the dynamic of the network (e.g., the occurrence of faults), we leverage a deep Q-network (DQN) and propose a fault-tolerant DQN-based solution. Finally, the simulation results show the high efficiency of our proposal in cost-saving and performance-enhancing.
引用
收藏
页码:7757 / 7790
页数:34
相关论文
共 44 条
[21]   Geographical Job Scheduling in Data Centers with Heterogeneous Demands and Servers [J].
Lu, Xingjian ;
Kong, Fanxin ;
Yin, Jianwei ;
Liu, Xue ;
Yu, Huiqun ;
Fan, Guisheng .
2015 IEEE 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, 2015, :413-420
[22]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[23]  
Neely M.J., 2010, Stochastic Network Optimization with Application to Communication and Queueing Systems, DOI DOI 10.2200/S00271ED1V01Y201006CNT007
[24]   Macroscopic-Microscopic Attention in LSTM Networks Based on Fusion Features for Gear Remaining Life Prediction [J].
Qin, Yi ;
Xiang, Sheng ;
Chai, Yi ;
Chen, Haizhou .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (12) :10865-10875
[25]  
Qureshi A., 2010, THESIS
[26]   DeepEE: Joint Optimization of Job Scheduling and Cooling Control for Data Center Energy Efficiency Using Deep Reinforcement Learning [J].
Ran, Yongyi ;
Hu, Han ;
Zhou, Xin ;
Wen, Yonggang .
2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, :645-655
[27]   Distributed Coordination of Internet Data Centers Under Multiregional Electricity Markets [J].
Rao, Lei ;
Liu, Xue ;
Ilic, Marija D. ;
Liu, Jie .
PROCEEDINGS OF THE IEEE, 2012, 100 (01) :269-282
[28]   SmartFCT: Improving power-efficiency for data center networks with deep reinforcement learning [J].
Sun, Penghao ;
Guo, Zehua ;
Liu, Sen ;
Lan, Julong ;
Wang, Junchao ;
Hu, Yuxiang .
COMPUTER NETWORKS, 2020, 179
[29]   Practical large-scale latency estimation [J].
Szymaniak, Michal ;
Presotto, David ;
Pierre, Guillaume ;
van Steen, Maarten .
COMPUTER NETWORKS, 2008, 52 (07) :1343-1364
[30]   Cost Efficient Design of Fault Tolerant Geo-Distributed Data Centers [J].
Tripathi, Rakesh ;
Vignesh, S. ;
Tamarapalli, Venkatesh ;
Medhi, Deep .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2017, 14 (02) :289-301