Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT

被引:160
作者
He, Xiaoming [1 ]
Wang, Kun [2 ,3 ]
Huang, Huawei [5 ]
Miyazaki, Toshiaki [4 ]
Wang, Yixuan [1 ]
Guo, Song [5 ]
机构
[1] Nanjing Univ Posts & Telecommun, Jiangsu Engn Res Ctr Commun & Network Technol, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Natl Engn Res Ctr Commun & Networking, Nanjing 210003, Jiangsu, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[4] Univ Aizu, Sch Comp Sci & Engn, Aizu Wakamatsu, Fukushima 9658580, Japan
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
基金
中国博士后科学基金;
关键词
Quality of experience; Resource management; Computational modeling; Heuristic algorithms; Quality of service; Wireless networks; Electronic mail; Green resource allocation; QoE; content-centric computing; IoT; deep reinforcement learning; PERFORMANCE; MANAGEMENT; PLACEMENT; ALGORITHM; SELECTION; NETWORK;
D O I
10.1109/TETC.2018.2805718
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the era of information, the green services of content-centric IoT are expected to offer users the better satisfaction of Quality of Experience (QoE) than that in a conventional IoT. Nevertheless, the network traffic and new demands from IoT users increase along with the promising of the content-centric computing system. Therefore, the satisfaction of QoE will become the major challenge in the content-centric computing system for IoT users. In this article, to enhance the satisfaction of QoE, we propose QoE models to evaluate the qualities of the IoT concerning both network and users. The value of QoE does not only refer to the network cost, but also the Mean Opinion Score (MOS) of users. Therefore, our models could capture the influence factors from network cost and services for IoT users based on IoT conditions. Specially, we mainly focus on the issues of cache allocation and transmission rate. Under this content-centric IoT, aiming to allocate the cache capacity among content-centric computing nodes and handle the transmission rates under a constrained total network cost and MOS for the whole IoT, we devote our efforts to the following two aspects. First, we formulate the QoE as a green resource allocation problem under the different transmission rate to acquire the best QoE. Then, in the basis of the node centrality, we will propose a suboptimal dynamic approach, which is suitable for IoT with content delivery frequently. Furthermore, we present a green resource allocation algorithm based on Deep Reinforcement Learning (DRL) to improve accuracy of QoE adaptively. Simulation results reveal that our proposals could achieve high QoE performance for content-centric IoT.
引用
收藏
页码:781 / 796
页数:16
相关论文
共 58 条
[1]   Fundamentals of Cluster-Centric Content Placement in Cache-Enabled Device-to-Device Networks [J].
Afshang, Mehrnaz ;
Dhillon, Harpreet S. ;
Chong, Peter Han Joo .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2016, 64 (06) :2511-2526
[2]   Optimal Content Placement for a Large-Scale VoD System [J].
Applegate, David ;
Archer, Aaron ;
Gopalakrishnan, Vijay ;
Lee, Seungjoon ;
Ramakrishnan, K. K. .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (04) :2114-2127
[3]   Joint Source-Channel Rate Allocation and Client Clustering for Scalable Multistream IPTV [J].
Chakareski, Jacob .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (08) :2429-2439
[4]  
Chen L, 2014, IEEE IJCNN, P1, DOI 10.1109/IJCNN.2014.6889506
[5]   Fastest Mixing Reversible Markov Chains on Graphs With Degree Proportional Stationary Distributions [J].
Cihan, Onur ;
Akar, Mehmet .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (01) :227-232
[6]   QoE-Oriented Rate Allocation for Multipath High-Definition Video Streaming Over Heterogeneous Wireless Access Networks [J].
Deng, Zhenjie ;
Liu, Yanwei ;
Liu, Jinxia ;
Zhou, Xu ;
Ci, Song .
IEEE SYSTEMS JOURNAL, 2017, 11 (04) :2524-2535
[7]   Memristor MOS Content Addressable Memory (MCAM): Hybrid Architecture for Future High Performance Search Engines [J].
Eshraghian, Kamran ;
Cho, Kyoung-Rok ;
Kavehei, Omid ;
Kang, Soon-Ku ;
Abbott, Derek ;
Kang, Sung-Mo Steve .
IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2011, 19 (08) :1407-1417
[8]   Energy-aware task assignment for mobile cyber-enabled applications in heterogeneous cloud computing [J].
Gai, Keke ;
Qiu, Meikang ;
Zhao, Hui .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2018, 111 :126-135
[9]   Dynamic energy-aware cloudlet-based mobile cloud computing model for green computing [J].
Gai, Keke ;
Qiu, Meikang ;
Zhao, Hui ;
Tao, Lixin ;
Zong, Ziliang .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2016, 59 :46-54
[10]  
Gao M., 2018, IEEE T IND INFORM, VPP, P1