Scheduling in an unstructured peer-to-peer-based high performance computing system

被引:3
|
作者
Luo, Fei [1 ]
Jin, Hai [1 ]
Liao, Xiaofei [1 ]
Zhang, Qin [1 ]
机构
[1] Huazhong Univ Sci & Technol, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Production scheduling; Resource management; Internet; Computer applications; Peer-to-Peer; High performance computing; Scheduling;
D O I
10.1108/03684921211275225
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Purpose - Peer-to-peer (P2P) communities have the capability to construct a powerful virtual supercomputer by assembling idle intemet cycles. The purpose of this paper is to present the scheduling issues in an unstructured P2P-based high performance computing (HPC) system to achieve high performance for applications. Design/methodology/approach - A new application model is proposed for the system, where applications are parallelized in the program level. To address high performance for these applications, the system resources are controlled in a semi-centralized 3-layer network, where volunteers form many autonomous unstructured P2P domains. Furthermore, based on such a resource management policy, a job scheduling strategy is adopted, which is collaborated by global and domain scheduling. The global scheduling is responsible for the balance among domains, while the domain scheduling resolve workpiles' execution in a domain. Findings - Theoretical analysis and a benchmark experiment show that the scheduling provides scalable and enormous computing capability in the P2P-based HPC system. Originality/value - The paper shows that scheduling helps P2HP (an unstructured P2P-based HPC system) provide scalable and enormous computing capability for HPC applications.
引用
收藏
页码:1209 / 1215
页数:7
相关论文
共 50 条
  • [21] Super Node-Based Trust Data Management on unstructured Peer-to-Peer Networks
    Lin, Huaiqing
    Shen, Zhao
    Qi, Yuhua
    2009 INTERNATIONAL SYMPOSIUM ON COMPUTER NETWORK AND MULTIMEDIA TECHNOLOGY (CNMT 2009), VOLUMES 1 AND 2, 2009, : 687 - 690
  • [22] High Performance Peer-to-Peer Distributed Computing with Application to Constrained Two-dimensional Guillotine Cutting Problem
    Hifi, Mhand
    Saadi, Toufik
    Haddadou, Nawel
    PROCEEDINGS OF THE 19TH INTERNATIONAL EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING, 2011, : 552 - 559
  • [23] Result verification and trust-based scheduling in peer-to-peer Grids
    Zhao, SY
    Lo, V
    GauthierDickey, C
    Fifth IEEE International Conference on Peer-to-Peer Computing, Proceedings, 2005, : 31 - 38
  • [25] 3PC: System Support for Adaptive Peer-to-Peer Pervasive Computing
    Handte, Marcus
    Schiele, Gregor
    Matjuntke, Verena
    Becker, Christian
    Marron, Pedro Jose
    ACM TRANSACTIONS ON AUTONOMOUS AND ADAPTIVE SYSTEMS, 2012, 7 (01)
  • [26] On high performance file distribution over peer-to-peer networks
    Chung, Tein-Yaw
    Chang, Yang-Hui
    Chen, Kun-Hung
    Chen, Yung-Mu
    PROCEEDINGS OF THE 10TH IASTED INTERNATIONAL CONFERENCE ON INTERNET AND MULTIMEDIA SYSTEMS AND APPLICATIONS, 2006, : 158 - +
  • [27] Efficient push-based packet scheduling for Peer-to-Peer live streaming
    Ning Liu
    Jinghan Yang
    Huajie Cui
    Guifeng Zheng
    Hongbin Chen
    Cluster Computing, 2013, 16 : 767 - 777
  • [28] A peer-to-peer resource scheduling approach for photonic grid network based on OBGP
    Wu, RZ
    Ji, YF
    NETWORK ARCHITECTURES, MANAGEMENT, AND APPLICATIONS III, PTS 1 AND 2, 2005, 6022
  • [29] A HIP-based peer-to-peer communication system
    Koskela, Joakim
    2008 INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS, VOLS 1 AND 2, 2008, : 343 - 349
  • [30] A Peer-to-Peer Recommender System Based on Spontaneous Affinities
    Ruffo, Giancarlo
    Schifanella, Rossano
    ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2009, 9 (01)