A NEW FRAMEWORK OF CLUSTER-BASED PARALLEL PROCESSING SYSTEM FOR HIGH-PERFORMANCE GEO-COMPUTING

被引:0
|
作者
Ma, Yan [1 ]
Liu, Dingsheng [1 ]
Li, Jingshan [1 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing 100086, Peoples R China
来源
2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5 | 2009年
关键词
high-performance computing; geo-computing; remote sensing image processing; system framework; parallel file system; parallel programming model;
D O I
暂无
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Up to now, It still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges To properly settle these main issues above, a new system framework for high performance gco-computing is presented in this paper A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
引用
收藏
页码:2429 / 2432
页数:4
相关论文
共 50 条
  • [31] A high-performance computing framework for Monte Carlo ocean color simulations
    Kajiyama, Tamito
    D'Alimonte, Davide
    Cunha, Jose C.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (04)
  • [32] A Scalable Runtime Fault Localization Framework for High-Performance Computing Systems
    Jian Gao
    Hongmei Wei
    Kang Yu
    Peng Qing
    International Journal of Parallel Programming, 2018, 46 : 749 - 761
  • [33] A Scalable Runtime Fault Localization Framework for High-Performance Computing Systems
    Gao, Jian
    Wei, Hongmei
    Yu, Kang
    Qing, Peng
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2018, 46 (04) : 749 - 761
  • [34] High-Performance Computing Architecture for Sample Value Processing in the Smart Grid
    Sun, Le
    Muguira, Leire
    Jimenez, Jaime
    Astarloa, Armando
    Lazaro, Jesus
    IEEE ACCESS, 2022, 10 : 12208 - 12218
  • [35] High-performance computing service over the Internet for intraoperative image processing
    Kawasaki, Y
    Ino, F
    Mizutani, Y
    Fujimoto, N
    Sasama, T
    Sato, Y
    Sugano, N
    Tamura, S
    Hagihara, K
    IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2004, 8 (01): : 36 - 46
  • [36] An Efficient Energy Consumption Prediction Framework for High Performance Computing Cluster Jobs
    Lou, Yantao
    Wang, Jibin
    Feng, Shoupeng
    Yu, Xian
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 259 - 265
  • [37] A Framework for End-to-End Simulation of High-performance Computing Systems
    Denzel, Wolfgang E.
    Li, Jian
    Walker, Peter
    Jin, Yuho
    SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL, 2010, 86 (5-6): : 331 - 350
  • [38] High Performance Processing of Satellite Data Using Distributed and Parallel Computing Techniques
    Damahe, Lalit B.
    Bramhe, Sanket S.
    Fursule, Nilay C.
    Shirbhate, Ram D.
    Ajmire, Pournima S.
    Kumar, Girish
    BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2020, 13 (14): : 404 - 409
  • [39] RESEARCH ON HIGH-PERFORMANCE COMPUTING NETWORK SEARCH SYSTEM BASED ON COMPUTER BIG DATA
    Chen, Xiaogang
    Liu, Dongmei
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2024, 25 (03): : 1833 - 1840
  • [40] In-depth analysis on parallel processing patterns for high-performance Dataframes
    Perera, Niranda
    Sarker, Arup Kumar
    Staylor, Mills
    von Laszewski, Gregor
    Shan, Kaiying
    Kamburugamuve, Supun
    Widanage, Chathura
    Abeykoon, Vibhatha
    Kanewela, Thejaka Amila
    Fox, Geoffrey
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 149 : 250 - 264