High throughput computing over peer-to-peer networks

被引:5
作者
Perez-Miguel, Carlos [1 ]
Miguel-Alonso, Jose [1 ]
Mendiburu, Alexander [1 ]
机构
[1] Univ Basque Country, UPV EHU, Dept Comp Architecture & Technol, Intelligent Syst Grp, San Sebastian 20018, Spain
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2013年 / 29卷 / 01期
关键词
Peer-to-peer networks; High throughput computing; Distributed hash tables;
D O I
10.1016/j.future.2011.08.011
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this work, we present a proposal to build a high throughput computing system totally based upon the Peer-to-Peer (P2P) paradigm. We discuss the general characteristics of P2P systems, with focus on P2P storage, and the expected characteristics of the HTC system: totally decentralized, not requiring permanent connection, and able to implement scheduling policies such as running jobs in a (non-strict) FCFS order. We have selected Cassandra as the supporting P2P storage system for our purposes. We discuss the basic aspects of the system implementation, and carry out some experiments designed to verify that it works as expected. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:352 / 360
页数:9
相关论文
共 57 条
[1]   Design and Implementation Trade-Offs for Wide-Area Resource Discovery [J].
Albrecht, Jeannie ;
Oppenheimer, David ;
Vahdat, Amin ;
Patterson, David A. .
ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2008, 8 (04)
[2]  
Anderson D.P., 2004, GRID 04, P4, DOI [10.1109/grid.2004.14, DOI 10.1109/GRID.2004.14]
[3]  
Andrzejak A., PROCEEDINGS OF THE S, P33
[4]  
[Anonymous], 2002, THE GNUTELLA PROTOCO
[5]  
Bessa S, 2007, IEEE SYMP COMP COMMU, P829
[6]   Mercury: Supporting scalable multi-attribute range queries [J].
Bharambe, AR ;
Agrawal, M ;
Seshan, S .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2004, 34 (04) :353-366
[7]   A self-organizing P2P system for VoIP application [J].
Bin, Dai ;
Furong, Wang ;
Jian, Liu .
2006 INTERNATIONAL CONFERENCE ON INFORMATION AND TECHNOLOGY: RESEARCH AND EDUCATION, 2006, :196-+
[8]  
Borthakur D., 2007, THE HADOOP DISTRIBUT
[9]  
Cai M., 2004, J GRID COMPUT, V2, P3, DOI DOI 10.1007/S10723-004-1184-Y
[10]  
Cao J, 2003, LECT NOTES COMPUTER, V3032, P316