A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
来源
2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5 | 2009年
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [1] Accelerating single molecule localization microscopy through parallel processing on a high-performance computing cluster
    Munro, I.
    Garcia, E.
    Yan, M.
    Guldbrand, S.
    Kumar, S.
    Kwakwa, K.
    Dunsby, C.
    Neil, M. A. A.
    French, P. M. W.
    JOURNAL OF MICROSCOPY, 2019, 273 (02) : 148 - 160
  • [2] Commodity Cluster Using Single System Image Based on Linux/Kerrighed for High-Performance Computing
    Setiawan, Iwan
    Murdyantoro, Eko
    2016 3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, COMPUTER, AND ELECTRICAL ENGINEERING (ICITACEE), 2016, : 367 - 372
  • [3] Dependable high performance computing on a parallel Sysplex Cluster
    Blochinger, W
    Bündgen, R
    Heinemann, A
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 1627 - 1633
  • [4] High-Performance Computing with Quantum Processing Units
    Britt, Keith A.
    Humble, Travis S.
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2017, 13 (03)
  • [5] A taxonomy of task-based parallel programming technologies for high-performance computing
    Peter Thoman
    Kiril Dichev
    Thomas Heller
    Roman Iakymchuk
    Xavier Aguilar
    Khalid Hasanov
    Philipp Gschwandtner
    Pierre Lemarinier
    Stefano Markidis
    Herbert Jordan
    Thomas Fahringer
    Kostas Katrinis
    Erwin Laure
    Dimitrios S. Nikolopoulos
    The Journal of Supercomputing, 2018, 74 : 1422 - 1434
  • [6] A taxonomy of task-based parallel programming technologies for high-performance computing
    Thoman, Peter
    Dichev, Kiril
    Heller, Thomas
    Iakymchuk, Roman
    Aguilar, Xavier
    Hasanov, Khalid
    Gschwandtner, Philipp
    Lemarinier, Pierre
    Markidis, Stefano
    Jordan, Herbert
    Fahringer, Thomas
    Katrinis, Kostas
    Laure, Erwin
    Nikolopoulos, Dimitrios S.
    JOURNAL OF SUPERCOMPUTING, 2018, 74 (04) : 1422 - 1434
  • [7] A Grid Computing Framework for High-Performance Medical Imaging
    Manana Guichon, Gabriel
    Romero Castro, Eduardo
    IX INTERNATIONAL SEMINAR ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2013, 8922
  • [8] NEMO A Network Monitoring Framework for High-performance Computing
    Calle, Elio Perez
    DCNET 2010/OPTICS 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON DATA COMMUNICATION NETWORKING AND INTERNATIONAL CONFERENCE ON OPTICAL COMMUNICATION SYSTEM, 2010, : 61 - 66
  • [9] Ninf and PM: Communication libraries for global computing and high-performance cluster computing
    Sato, M
    Tezuka, H
    Hori, A
    Ishikawa, Y
    Sekiguchi, S
    Nakada, H
    Matsuoka, S
    Nagashima, U
    FUTURE GENERATION COMPUTER SYSTEMS, 1998, 13 (4-5) : 349 - 359
  • [10] Parallel computing in bioinformatics: a view from high-performance, heterogeneous, and cloud computing
    Vega-Rodriguez, Miguel A.
    Santander-Jimenez, Sergio
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (07) : 3369 - 3373