On Unbiased Sampling for Unstructured Peer-to-Peer Networks

被引:106
作者
Stutzbach, Daniel [1 ]
Rejaie, Reza [2 ]
Duffield, Nick [3 ]
Sen, Subhabrata [3 ]
Willinger, Walter [3 ]
机构
[1] Stutzbach Enterprises LLC, Dallas, TX 75206 USA
[2] Univ Oregon, Dept Comp Sci, Eugene, OR 97403 USA
[3] AT&T Labs Res, Florham Pk, NJ 07932 USA
基金
美国国家科学基金会;
关键词
Peer-to-peer; sampling;
D O I
10.1109/TNET.2008.2001730
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a detailed examination of how the dynamic and heterogeneous nature of real-world peer-to-peer systems can introduce bias into the selection of representative samples of peer properties (e.g., degree, link bandwidth, number of files shared). We propose the Metropolized Random Walk with Backtracking (MRWB) as a viable and promising technique for collecting nearly unbiased samples and conduct an extensive simulation study to demonstrate that our technique works well for a wide variety of commonly-encountered peer-to-peer network conditions. We have implemented the MRWB algorithm for selecting peer addresses uniformly at random into a tool called ion-sampler. Using the Gnutella network, we empirically show that ion-sampler yields more accurate samples than tools that rely on commonly-used sampling techniques and results in dramatic improvements in efficiency and scalability compared to performing a full crawl.
引用
收藏
页码:377 / 390
页数:14
相关论文
共 50 条
  • [31] OPTIMIZED QUERY FORWARDING FOR RESOURCE DISCOVERY IN UNSTRUCTURED PEER-TO-PEER GRIDS
    Noghabi, Hossein Boroumand
    Ismail, Abdul Samad
    Ahmed, Aboamama Atahar
    Khodaei, Masoumeh
    CYBERNETICS AND SYSTEMS, 2012, 43 (08) : 687 - 703
  • [32] A framework for mobile agents in Peer-to-Peer networks
    Lübke, D
    Gómez, JM
    7TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL XIII, PROCEEDINGS: SYSTEMICS, CYBERNETICS AND INFORMATICS: TECHNOLOGIES AND APPLICATIONS, 2003, : 101 - 103
  • [33] A NAT Traversal Mechanism for Peer-To-Peer Networks
    Zhang, Zepeng
    Wen, Xiangming
    Zheng, Wei
    2009 INTERNATIONAL SYMPOSIUM ON INTELLIGENT UBIQUITOUS COMPUTING AND EDUCATION, 2009, : 129 - 132
  • [34] Asynchronous resource discovery in peer-to-peer networks
    Kutten, Shay
    Peleg, David
    COMPUTER NETWORKS, 2007, 51 (01) : 190 - 206
  • [35] An OPNET simulation model for peer-to-peer networks
    Hawa, Mohammed
    SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL, 2013, 89 (08): : 1009 - 1019
  • [36] Answering similarity queries in peer-to-peer networks
    Kalnis, P
    Ng, WS
    Ooi, BC
    Tan, KL
    INFORMATION SYSTEMS, 2006, 31 (01) : 57 - 72
  • [37] Controlling Mechanism for the Hubs in Peer-to-Peer Networks
    Liu, Yuhua
    Yang, Chun
    Xu, Kaihua
    Chen, Hongcai
    2008 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY, VOLS 1 AND 2, PROCEEDINGS, 2008, : 511 - +
  • [38] MALWARE SPREADING MODELS IN PEER-TO-PEER NETWORKS
    Schafer, Jiri
    Malinka, Kamil
    Hanacek, Petr
    42ND ANNUAL 2008 IEEE INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY, PROCEEDINGS, 2008, : 339 - 345
  • [39] Semantic Information Retrieval on Peer-to-Peer Networks
    Erturk, Mehmet Ali
    Zaim, A. Halim
    Akyokus, Selim
    NETWORKED DIGITAL TECHNOLOGIES, PT 2, 2010, 88 : 715 - +
  • [40] Distributed shell over peer-to-peer networks
    Truong, M
    Harwood, A
    PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 269 - 275