Load-Balancing of Kubernetes-Based Edge Computing Infrastructure Using Resource Adaptive Proxy

被引:15
作者
Nguyen, Quang-Minh [1 ]
Phan, Linh-An [1 ]
Kim, Taehong [1 ]
机构
[1] Chungbuk Natl Univ, Sch Informat & Commun Engn, Cheongju 28644, South Korea
基金
新加坡国家研究基金会;
关键词
containerization; edge computing; Kubernetes; kube-proxy; load-balancing; metric-server; microservice; CONTAINER ORCHESTRATION; CLOUD; ALLOCATION;
D O I
10.3390/s22082869
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Kubernetes (K8s) is expected to be a key container orchestration tool for edge computing infrastructures owing to its various features for supporting container deployment and dynamic resource management. For example, its horizontal pod autoscaling feature provides service availability and scalability by increasing the number of replicas. kube-proxy provides traffic load-balancing between replicas by distributing client requests equally to all pods (replicas) of an application in a K8s cluster. However, this approach can result in long delays when requests are forwarded to remote workers, especially in edge computing environments where worker nodes are geographically dispersed. Moreover, if the receiving worker is overloaded, the request-processing delay can increase significantly. To overcome these limitations, this paper proposes an enhanced load balancer called resource adaptive proxy (RAP). RAP periodically monitors the resource status of each pod and the network status among worker nodes to aid in load-balancing decisions. Furthermore, it preferentially handles requests locally to the maximum extent possible. If the local worker node is overloaded, RAP forwards its requests to the best node in the cluster while considering resource availability. Our experimental results demonstrated that RAP could significantly improve throughput and reduce request latency compared with the default load-balancing mechanism of K8s.
引用
收藏
页数:16
相关论文
共 35 条
  • [1] Resource Provisioning in Edge Computing for Latency-Sensitive Applications
    Abouaomar, Amine
    Cherkaoui, Soumaya
    Mlika, Zoubeir
    Kobbane, Abdellatif
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (14) : 11088 - 11099
  • [2] An Intelligent IoT Approach for Analyzing and Managing Crowds
    Al-Nabhan, Najla
    Alenazi, Shouq
    Alquwaifili, Salwa
    Alzamzami, Shahad
    Altwayan, Leen
    Alaloula, Nouf
    Alowaini, Raghad
    Al Islam, A. B. M. Alim
    [J]. IEEE ACCESS, 2021, 9 : 104874 - 104886
  • [3] Improving IoT Services Using a Hybrid Fog-Cloud Offloading
    Aljanabi, Saif
    Chalechale, Abdolah
    [J]. IEEE ACCESS, 2021, 9 (09): : 13775 - 13788
  • [4] How Can Edge Computing Benefit From Software-Defined Networking: A Survey, Use Cases, and Future Directions
    Baktir, Ahmet Cihat
    Ozgovde, Atay
    Ersoy, Cem
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2017, 19 (04): : 2359 - 2391
  • [5] Bonomi F., 2012, 1 EDITION MCC WORKSH, P13, DOI DOI 10.1145/2342509.2342513
  • [6] Quality of Service Provision in Fog Computing: Network-Aware Scheduling of Containers
    Caminero, Agustin C.
    Munoz-Mansilla, Rocio
    [J]. SENSORS, 2021, 21 (12)
  • [7] Foundations and Evolution of Modern Computing Paradigms: Cloud, IoT, Edge, and Fog
    De Donno, Michele
    Tange, Koen
    Dragoni, Nicola
    [J]. IEEE ACCESS, 2019, 7 : 150936 - 150948
  • [8] Docker-Based Intelligent Fall Detection Using Edge-Fog Cloud Infrastructure
    Divya, V
    Sri, R. Leena
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (10) : 8133 - 8144
  • [9] Eidenbenz R, 2020, 2020 FIFTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), P164, DOI [10.1109/fmec49853.2020.9144934, 10.1109/FMEC49853.2020.9144934]
  • [10] Felter W, 2015, INT SYM PERFORM ANAL, P171, DOI 10.1109/ISPASS.2015.7095802