Decoupling As a Foundation for Large Scale Parallel Computing

被引:0
|
作者
Shi, Justin Y. [1 ]
机构
[1] Temple Univ, CIS Dept, Philadelphia, PA 19122 USA
关键词
Fault Tolerant High Performance Computing Architecture; Parallel Markup Language; Dataflow Parallel Processing; Tuple Space Parallel Programming;
D O I
10.1109/HPCC.2009.53
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The "main-stream" inter-process communication models (share-memory and message-passing) require the programmers responsible for the construction of a very complex state machine for parallel processing. This has resulted multiple difficulties including programming, performance tuning, debugging, job scheduling and fault tolerance. The most troubling is the degree of difficulties. It increases exponentially as the multiprocessor grows in size. Inspired by the successes of packet switching protocols, this paper reports our preliminary findings in using decoupling technologies for parallel applications with high reliability, high performance and programmability.
引用
收藏
页码:87 / 94
页数:8
相关论文
共 50 条
  • [1] Large-Scale Parallel Computing on Grids
    Bal, Henri
    Verstoep, Kees
    ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2008, 220 (02) : 3 - 17
  • [2] Large Scale Parallel Computing for Fluid Dynamics on Unstructured Grid
    Tang, Jing
    Li, Bin
    Chen, Jiangtao
    Gong, Xiaoquan
    2016 15TH INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING (ISPDC), 2016, : 64 - 69
  • [3] Java']Java communications for large-scale parallel computing
    Getov, V
    Philippsen, M
    LARGE-SCALE SCIENTIFIC COMPUTING, 2001, 2179 : 33 - 45
  • [4] Parallel computing tests on large-scale convex optimization
    Kallio, M
    Salo, S
    APPLIED PARALLEL COMPUTING: LARGE SCALE SCIENTIFIC AND INDUSTRIAL PROBLEMS, 1998, 1541 : 275 - 280
  • [5] A Parallel Computing Platform for Training Large Scale Neural Networks
    Gu, Rong
    Shen, Furao
    Huang, Yihua
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [6] Research on parallel visualization in large-scale scientific computing
    Gao, Jiaquan
    Zhao, Duanyang
    ICAT 2006: 16TH INTERNATIONAL CONFERENCE ON ARTIFICIAL REALITY AND TELEXISTENCE - WORSHOPS, PROCEEDINGS, 2006, : 149 - +
  • [7] GPU enhanced parallel computing for large scale data clustering
    Cui, Xiaohui
    St Charles, Jesse
    Potok, Thomas
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (07): : 1736 - 1741
  • [8] Efficient Straggler Replication in Large-Scale Parallel Computing
    Wang, Da
    Joshi, Gauri
    Wornell, Gregory W.
    ACM TRANSACTIONS ON MODELING AND PERFORMANCE EVALUATION OF COMPUTING SYSTEMS, 2019, 4 (02)
  • [9] Towards heterogeneous multi-scale computing on large scale parallel supercomputers
    Alowayyed S.
    Vassaux M.
    Czaja B.
    Coveney P.V.
    Hoekstra A.G.
    Supercomputing Frontiers and Innovations, 2019, 6 (04) : 20 - 43
  • [10] A Fast Parallel Large-scale Grid Generator for Parallel Computing in Engineering Simulation
    Wang, Xiaoqing
    Jin, Xianlong
    2016 IEEE INTERNATIONAL CONFERENCE OF ONLINE ANALYSIS AND COMPUTING SCIENCE (ICOACS), 2016, : 96 - 99