Constant Time Updates in Hierarchical Heavy Hitters

被引:77
作者
Ben Basat, Ran [1 ]
Einziger, Gil [2 ]
Friedman, Roy [1 ]
Luizelli, Marcelo C. [3 ]
Waisbard, Erez [2 ]
机构
[1] Technion, Haifa, Israel
[2] Nokia Bell Labs, Holmdel, NJ USA
[3] Univ Fed Rio Grande do Sul, Porto Alegre, RS, Brazil
来源
SIGCOMM '17: PROCEEDINGS OF THE 2017 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION | 2017年
关键词
Streaming; Heavy Hitters; Measurement; Monitoring; FINDING FREQUENT;
D O I
10.1145/3098822.3098832
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Monitoring tasks, such as anomaly and DDoS detection, require identifying frequent flow aggregates based on common IP prefixes. These are known as hierarchical heavy hitters (HHH), where the hierarchy is determined based on the type of prefixes of interest in a given application. The per packet complexity of existing HHH algorithms is proportional to the size of the hierarchy, imposing significant overheads. In this paper, we propose a randomized constant time algorithm for HHH. We prove probabilistic precision bounds backed by an empirical evaluation. Using four real Internet packet traces, we demonstrate that our algorithm indeed obtains comparable accuracy and recall as previous works, while running up to 62 times faster. Finally, we extended Open vSwitch (OVS) with our algorithm and showed it is able to handle 13.8 million packets per second. In contrast, incorporating previous works in OVS only obtained 2.5 times lower throughput.
引用
收藏
页码:127 / 140
页数:14
相关论文
共 41 条
  • [1] CONGA: Distributed Congestion-Aware Load Balancing for Datacenters
    Alizadeh, Mohammad
    Edsall, Tom
    Dharmapurikar, Sarang
    Vaidyanathan, Ramanan
    Chu, Kevin
    Fingerhut, Andy
    Vinh The Lam
    Matus, Francis
    Pan, Rong
    Yadav, Navindra
    Varghese, George
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2014, 44 (04) : 503 - 514
  • [2] pFabric: Minimal Near-Optimal Datacenter Transport
    Alizadeh, Mohammad
    Yang, Shuang
    Sharif, Milad
    Katti, Sachin
    McKeown, Nick
    Prabhakar, Balaji
    Shenker, Scott
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2013, 43 (04) : 435 - 446
  • [3] [Anonymous], CAIDA ANONYMIZED 201
  • [4] [Anonymous], 2008, ACM Trans. Knowl. Discov., DOI DOI 10.1145/1324172.1324174DATA
  • [5] [Anonymous], 2004, ACM SIGMOD
  • [6] Basat Ran Ben, RHHH CODE
  • [7] Ben-Basat R, 2016, IEEE INFOCOM SER
  • [8] Ben-Basat Ran, 2017, IEEE INFOCOM
  • [9] Benson T., 2011, P 7 C EM NETW EXP TE
  • [10] Charikar M, 2002, LECT NOTES COMPUT SC, V2380, P693