The Application of Cloud Computing to the Creation of Image Mosaics and Management of Their Provenance

被引:2
作者
Berriman, G. Bruce [1 ]
Deelman, Ewa [2 ]
Groth, Paul [2 ]
Juve, Gideon [2 ]
机构
[1] CALTECH, Infrared Proc & Anal Ctr, 770 S Wilson Ave, Pasadena, CA 91125 USA
[2] Univ Southern Calif, Informat Sci Inst, Marina Del Rey, CA 90292 USA
来源
SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY | 2010年 / 7740卷
关键词
Image processing; image mosaics; cloud computing; computational performance; provenance; high performance clusters; astronomical images;
D O I
10.1117/12.856486
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
We have used the Montage image mosaic engine to investigate the cost and performance of processing images on the Amazon EC2 cloud, and to inform the requirements that higher-level products impose on provenance management technologies. We will present a detailed comparison of the performance of Montage on the cloud and on the Abe high performance cluster at the National Center for Supercomputing Applications (NCSA). Because Montage generates many intermediate products, we have used it to understand the science requirements that higher-level products impose on provenance management technologies. We describe experiments with provenance management technologies such as the "Provenance Aware Service Oriented Architecture" (PASOA).
引用
收藏
页数:15
相关论文
共 16 条
  • [1] Committee on Ensuring the Utility and Integrity of Research Data in a Digital Age, 2009, ENS INT ACC STEW RES
  • [2] Deelman E., 2005, Scientific Programming, V13, P219
  • [3] Deelman Ewa., 2010, Scientific Data Management, Challenges, Technology and Deployment
  • [4] Evangelinos C., 2008, Cloud Computing and Its Applications (CCA08)
  • [5] Foster I., 2006, GLOBUS TOOLKIT VERSI
  • [6] Condor-G: A Computation Management Agent for Multi-Institutional Grids
    James Frey
    Todd Tannenbaum
    Miron Livny
    Ian Foster
    Steven Tuecke
    [J]. Cluster Computing, 2002, 5 (3) : 237 - 246
  • [7] GROTH P, 2009, P SUP 09
  • [8] HEY, 2009, 4 PARADIGM DATA INTE, pR17
  • [9] Juve G., 2009, CLOUD COMP WORKSH CO
  • [10] Litzkow M. J., 1988, 8th International Conference on Distributed Computing Systems (Cat. No.88CH2541-1), P104, DOI 10.1109/DCS.1988.12507