Graph-Reinforcement-Learning-Based Dependency-Aware Microservice Deployment in Edge Computing

被引:12
作者
Lv, Wenkai [1 ,2 ]
Yang, Pengfei [1 ,2 ]
Zheng, Tianyang [1 ,2 ]
Lin, Chengmin [1 ,2 ]
Wang, Zhenyi [1 ,2 ]
Deng, Minwen [3 ]
Wang, Quan [1 ,2 ]
机构
[1] Sch Comp Sci & Technol, Xian 710071, Peoples R China
[2] Key Lab Smart Human Comp Interact & Wearable Techn, Xian 710071, Peoples R China
[3] Tencent AI Lab, Shenzhen 518000, Peoples R China
关键词
Microservice architectures; Quality of service; Time factors; Internet of Things; Computer architecture; Servers; Edge computing; Deep reinforcement learning (DRL); edge computing; graph convolutional network (GCN); microservice deployment; Quality of Service (QoS);
D O I
10.1109/JIOT.2023.3289228
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a design philosophy that achieves decoupling by decomposing a monolithic application into multiple lightweight microservices. Meanwhile, edge computing can significantly reduce service latency and network congestion by extending computation and storage resources to the network edge. Therefore, in the microservice-oriented edge computing platform, a fundamental problem is how to efficiently deploy microservices with complex dependencies on the resource-constrained edge servers to satisfy the Quality of Service (QoS) constraints of users. Most of the existing studies ignore multiple call graphs with differentiated dependencies for an application, which often result in the violation of QoS. To address this issue, in this article, we first model the request response time of multiple instances and multiple call graphs scenario with service conflicts. Then, different from the existing heuristic or approximation algorithms which rely heavily on expert knowledge, we propose a graph-reinforcement-learning-based deployment (GRLD) framework. GRLD uses a graph convolutional network (GCN) to extract the graph data required for multiple call graphs with messages passing and aggregation, and the generated feature is fed into the underlying network of deep-reinforcement-learning (DRL). Experimental results show that GRLD outperforms counterparts in reducing service deployment overhead while satisfying QoS constraints of multiple call graphs.
引用
收藏
页码:1604 / 1615
页数:12
相关论文
共 41 条
[21]   Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis [J].
Luo, Shutian ;
Xu, Huanle ;
Lu, Chengzhi ;
Ye, Kejiang ;
Xu, Guoyao ;
Zhang, Liping ;
Ding, Yu ;
He, Jian ;
Xu, Chengzhong .
PROCEEDINGS OF THE 2021 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '21), 2021, :412-426
[22]   Energy Consumption and QoS-Aware Co-Offloading for Vehicular Edge Computing [J].
Lv, Wenkai ;
Yang, Pengfei ;
Zheng, Tianyang ;
Yi, Bijie ;
Ding, Yunqing ;
Wang, Quan ;
Deng, Minwen .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (06) :5214-5225
[23]   Microservice Deployment in Edge Computing Based on Deep Q Learning [J].
Lv, Wenkai ;
Wang, Quan ;
Yang, Pengfei ;
Ding, Yunqing ;
Yi, Bijie ;
Wang, Zhenyi ;
Lin, Chengmin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (11) :2968-2978
[24]   Multi-objective microservice deployment optimization via a knowledge-driven evolutionary algorithm [J].
Ma, Wubin ;
Wang, Rui ;
Gu, Yuanlin ;
Meng, Qinggang ;
Huang, Hongbin ;
Deng, Su ;
Wu, Yahui .
COMPLEX & INTELLIGENT SYSTEMS, 2021, 7 (03) :1153-1171
[25]  
Kipf TN, 2017, Arxiv, DOI arXiv:1609.02907
[26]  
Nadareishvili Irakli, 2016, MICROSERVICE ARCHITE
[27]   CLITE: Efficient and QoS-Aware Co-location of Multiple Latency-Critical Jobs for Warehouse Scale Computers [J].
Patel, Tirthak ;
Tiwari, Devesh .
2020 IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE COMPUTER ARCHITECTURE (HPCA 2020), 2020, :193-206
[28]   Towards Microservice Smells Detection [J].
Pigazzini, Ilaria ;
Fontana, Francesca Arcelli ;
Lenarduzzi, Valentina ;
Taibi, Davide .
2020 IEEE/ACM INTERNATIONAL CONFERENCE ON TECHNICAL DEBT, TECHDEBT, 2020, :92-97
[29]   Demand-Driven Deep Reinforcement Learning for Scalable Fog and Service Placement [J].
Sami, Hani ;
Mourad, Azzam ;
Otrok, Hadi ;
Bentahar, Jamal .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (05) :2671-2684
[30]   Edge Computing: Vision and Challenges [J].
Shi, Weisong ;
Cao, Jie ;
Zhang, Quan ;
Li, Youhuizi ;
Xu, Lanyu .
IEEE INTERNET OF THINGS JOURNAL, 2016, 3 (05) :637-646