Graph-Reinforcement-Learning-Based Dependency-Aware Microservice Deployment in Edge Computing

被引:7
作者
Lv, Wenkai [1 ,2 ]
Yang, Pengfei [1 ,2 ]
Zheng, Tianyang [1 ,2 ]
Lin, Chengmin [1 ,2 ]
Wang, Zhenyi [1 ,2 ]
Deng, Minwen [3 ]
Wang, Quan [1 ,2 ]
机构
[1] Sch Comp Sci & Technol, Xian 710071, Peoples R China
[2] Key Lab Smart Human Comp Interact & Wearable Techn, Xian 710071, Peoples R China
[3] Tencent AI Lab, Shenzhen 518000, Peoples R China
关键词
Microservice architectures; Quality of service; Time factors; Internet of Things; Computer architecture; Servers; Edge computing; Deep reinforcement learning (DRL); edge computing; graph convolutional network (GCN); microservice deployment; Quality of Service (QoS);
D O I
10.1109/JIOT.2023.3289228
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a design philosophy that achieves decoupling by decomposing a monolithic application into multiple lightweight microservices. Meanwhile, edge computing can significantly reduce service latency and network congestion by extending computation and storage resources to the network edge. Therefore, in the microservice-oriented edge computing platform, a fundamental problem is how to efficiently deploy microservices with complex dependencies on the resource-constrained edge servers to satisfy the Quality of Service (QoS) constraints of users. Most of the existing studies ignore multiple call graphs with differentiated dependencies for an application, which often result in the violation of QoS. To address this issue, in this article, we first model the request response time of multiple instances and multiple call graphs scenario with service conflicts. Then, different from the existing heuristic or approximation algorithms which rely heavily on expert knowledge, we propose a graph-reinforcement-learning-based deployment (GRLD) framework. GRLD uses a graph convolutional network (GCN) to extract the graph data required for multiple call graphs with messages passing and aggregation, and the generated feature is fed into the underlying network of deep-reinforcement-learning (DRL). Experimental results show that GRLD outperforms counterparts in reducing service deployment overhead while satisfying QoS constraints of multiple call graphs.
引用
收藏
页码:1604 / 1615
页数:12
相关论文
共 41 条
  • [1] Deployment and communication patterns in microservice architectures: A systematic literature review
    Aksakalli, Isil Karabey
    Celik, Turgay
    Can, Ahmet Burak
    Tekinerdogan, Bedir
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2021, 180
  • [2] Al-Masri E, 2018, IEEE INT CONF BIG DA, P5119, DOI 10.1109/BigData.2018.8622557
  • [3] GNN4REL: Graph Neural Networks for Predicting Circuit Reliability Degradation
    Alrahis, Lilas
    Knechtel, Johann
    Klemme, Florian
    Amrouch, Hussam
    Sinanoglu, Ozgur
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 3826 - 3837
  • [4] Scalability Assessment of Microservice Architecture Deployment Configurations: A Domain-based Approach Leveraging Operational Profiles and Load Tests
    Avritzer, Alberto
    Ferme, Vincenzo
    Janes, Andrea
    Russo, Barbara
    van Hoorn, Andre
    Schulz, Henning
    Menasche, Daniel
    Rufino, Vilc
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2020, 165
  • [5] Multitask Offloading Strategy Optimization Based on Directed Acyclic Graphs for Edge Computing
    Chen, Jiawen
    Yang, Yajun
    Wang, Chenyang
    Zhang, Heng
    Qiu, Chao
    Wang, Xiaofei
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) : 9367 - 9378
  • [6] Chun-Ting Lin, 2020, P IEEE ACM 42 INT C, P36
  • [7] Optimal Application Deployment in Resource Constrained Distributed Edges
    Deng, Shuiguang
    Xiang, Zhengzhe
    Taheri, Javid
    Khoshkholghi, Mohammad Ali
    Yin, Jianwei
    Zomaya, Albert Y.
    Dustdar, Schahram
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (05) : 1907 - 1923
  • [8] Adaptive Resource Efficient Microservice Deployment in Cloud-Edge Continuum
    Fu, Kaihua
    Zhang, Wei
    Chen, Quan
    Zeng, Deze
    Guo, Minyi
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (08) : 1825 - 1840
  • [9] Two Level Control of Non-Player Characters for Navigation in 3D Games Scenes: A Deep Reinforcement Learning Approach
    Gomes, Gilzamir
    Vidal, Creto A.
    Cavalcante-Neto, Joaquim B.
    Nogueira, Yuri L. B.
    [J]. 2021 20TH BRAZILIAN SYMPOSIUM ON COMPUTER GAMES AND DIGITAL ENTERTAINMENT (SBGAMES 2021), 2021, : 182 - 190
  • [10] Scheduling IoT Applications in Edge and Fog Computing Environments: A Taxonomy and Future Directions
    Goudarzi, Mohammad
    Palaniswami, Marimuthu
    Buyya, Rajkumar
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (07)