Overload Control for Scaling WeChat Microservices

被引：70

作者：

Zhou, Hao ^{[1
]}

Chen, Ming ^{[1
]}

Lin, Qian ^{[2
]}

Wang, Yong ^{[1
]}

She, Xiaobin ^{[1
]}

Liu, Sifan ^{[1
]}

Gu, Rui ^{[3
]}

Ooi, Beng Chin ^{[2
]}

Yang, Junfeng ^{[3
]}

机构：

[1] Tencent Inc, Shenzhen, Peoples R China

[2] Natl Univ Singapore, Singapore, Singapore

[3] Columbia Univ, New York, NY USA

来源：

PROCEEDINGS OF THE 2018 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '18) | 2018年

关键词：

overload control; service admission control; microservice architecture; WeChat;

D O I：

10.1145/3267809.3267823

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Effective overload control for large-scale online service system is crucial for protecting the system backend from overload. Conventionally, the design of overload control is ad-hoc for individual service. However, service-specific overload control could be detrimental to the overall system due to intricate service dependencies or flawed implementation of service. Service developers usually have difficulty to accurately estimate the dynamics of actual workload during the development of service. Therefore, it is essential to decouple the overload control from service logic. In this paper, we propose DAGOR, an overload control scheme designed for the account-oriented microservice architecture. DAGOR is service agnostic and system-centric. It manages overload at the microservice granule such that each microservice monitors its load status in real time and triggers load shedding in a collaborative manner among its relevant services when overload is detected. DAGOR has been used in the WeChat backend for five years. Experimental results show that DAGOR can benefit high success rate of service even when the system is experiencing overload, while ensuring fairness in the overload control.

引用

页码：149 / 161

页数：13

共 33 条

[21]

Menasce D. A., 2001, Capacity Planning for Web Services: Metrics, Models, and Methods

[22]

Meulenhoff Pieter J., 2009, P INT JOINT C SERV O

[23] Eliminating receive livelock in an interrupt-driven kernel [J].

Mogul, JC ;

Ramakrishnan, KK .

ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1997, 15 (03) :217-252

[24]

Mohapatra P., 2002, P IEEE INT C COMP CO

[25]

Nichols K., 2012, Communications of the ACM, V10, P20, DOI [DOI 10.1145/2209249.2209264, 10.1145/2209249.2209264, DOI 10.1145/2208917.2209336, 10.1145/2208917.2209336]

[26]

Qian Lin, 2015, P ACM SIGMOD INT C M

[27]

Suresh Lalith, 2017, P ACM S CLOUD COMP S

[28]

Tatbul N., 2006, 22 INT C DAT ENG WOR

[29]

Tatbul Nesime, 2007, P INT C VERY LARGE D

[30] Overload traffic management for sensor networks [J].

Wan, Chieh-Yih ;

Eisenman, Shane B. ;

Campbell, Andrew T. ;

Crowcroft, Jon .

ACM TRANSACTIONS ON SENSOR NETWORKS, 2007, 3 (04)

← 1 2 3 4 →