Practical large-scale latency estimation

被引:25
作者
Szymaniak, Michal [1 ]
Presotto, David [2 ]
Pierre, Guillaume [1 ]
van Steen, Maarten [1 ]
机构
[1] Vrije Univ Amsterdam, Dept Comp Sci, NL-1081 HV Amsterdam, Netherlands
[2] Google Inc, Mountain View, CA USA
关键词
large-scale distributed systems; network modeling; latency estimation;
D O I
10.1016/j.comnet.2007.11.022
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present the implementation of a large-scale latency estimation system based on GNP and incorporated into the Google content delivery network. Our implementation employs standard features of contemporary Web clients, and carefully controls the overhead incurred by latency measurements using a scalable centralized scheduler. It also requires only a small number of CDN modifications, which makes it attractive for any CDN interested in large-scale latency estimation. We investigate the issue of coordinate stability over time and show that coordinates drift away from their initial values with time, so that 25% of node coordinates become inaccurate by more than 33 ins after one week. However, daily re-computations make 75% of the coordinates stay within 6 ms of their initial values. Furthermore, we demonstrate that using coordinates to decide on client-to-replica re-direction leads to selecting replicas closest in term of measured latency in 86% of all cases. In another 10% of all cases, clients are re-directed to replicas offering latencies that are at most two times longer than optimal. Finally, collecting a huge volume of latency data and using clustering techniques enable us to estimate latencies between globally distributed Internet hosts that have not participated in our measurements at all. The results are sufficiently promising that Google may offer a public interface to the latency estimates in the future. (c) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:1343 / 1364
页数:22
相关论文
共 38 条
  • [1] AMINI L, 2004, P 24 INT C DISTR COM
  • [2] ANDREWS M, 2002, P 21 INFOCOM C IEEE
  • [3] [Anonymous], 2616 RFC IETF
  • [4] Web search for a planet:: The Google cluster architecture
    Barroso, LA
    Dean, J
    Hölzle, U
    [J]. IEEE MICRO, 2003, 23 (02) : 22 - 28
  • [5] The anatomy of a large-scale hypertextual Web search engine
    Brin, S
    Page, L
    [J]. COMPUTER NETWORKS AND ISDN SYSTEMS, 1998, 30 (1-7): : 107 - 117
  • [6] BRINKMAN N, 2006, ONESTAT COM JUL
  • [7] CASTRO M, 2003, MSRTR200353
  • [8] COX R, 2003, P 2 WORKSH HOT TOP N
  • [9] DABEK F, 2004, P SIGCOMM C ACM NEW
  • [10] DABEK F, 2004, P 1 S NETW SYST DES