Skyport - Container-Based Execution Environment Management for Multi-Cloud Scientific Workflows

被引:64
作者
Gerlach, Wolfgang [1 ,2 ]
Tang, Wei [2 ]
Keegan, Kevin [1 ,2 ]
Harrison, Travis [1 ,2 ]
Wilke, Andreas [2 ]
Bischof, Jared [1 ,2 ]
D'Souza, Mark [1 ,2 ]
Devoid, Scott [1 ,2 ]
Murphy-Olson, Daniel [1 ,2 ]
Desai, Narayan [3 ]
Meyer, Folker [1 ,2 ]
机构
[1] Univ Chicago, Chicago, IL 60637 USA
[2] Argonne Natl Lab, Argonne, IL USA
[3] Ericsson, San Jose, CA USA
来源
2014 5TH INTERNATIONAL WORKSHOP ON DATA-INTENSIVE COMPUTING IN THE CLOUDS (DATACLOUD) | 2014年
关键词
D O I
10.1109/DataCloud.2014.6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, Linux container technology has been gaining attention as it promises to transform the way software is developed and deployed. The portability and ease of deployment makes Linux containers an ideal technology to be used in scientific workflow platforms. Skyport utilizes Docker Linux containers to solve software deployment problems and resource utilization inefficiencies inherent to all existing scientific workflow platforms. As an extension to AWE/Shock, our data analysis platform that provides scalable workflow execution environments for scientific data in the cloud, Sky port greatly reduces the complexity associated with providing the environment necessary to execute complex workflows.
引用
收藏
页码:25 / 32
页数:8
相关论文
共 26 条
[1]   Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support [J].
Abouelhoda, Mohamed ;
Issa, Shadi Alaa ;
Ghanem, Moustafa .
BMC BIOINFORMATICS, 2012, 13
[2]   Galaxy CloudMan: delivering cloud compute clusters [J].
Afgan, Enis ;
Baker, Dannon ;
Coraor, Nate ;
Chapman, Brad ;
Nekrutenko, Anton ;
Taylor, James .
BMC BIOINFORMATICS, 2010, 11
[3]  
ALTINTAS I, 2012, P WORKSH DAT AN CLOU
[4]  
[Anonymous], 2013, ABS13037195 CORR
[5]  
[Anonymous], 2007, P LINUX S DTTAW DNTO
[6]   QIIME allows analysis of high-throughput community sequencing data [J].
Caporaso, J. Gregory ;
Kuczynski, Justin ;
Stombaugh, Jesse ;
Bittinger, Kyle ;
Bushman, Frederic D. ;
Costello, Elizabeth K. ;
Fierer, Noah ;
Pena, Antonio Gonzalez ;
Goodrich, Julia K. ;
Gordon, Jeffrey I. ;
Huttley, Gavin A. ;
Kelley, Scott T. ;
Knights, Dan ;
Koenig, Jeremy E. ;
Ley, Ruth E. ;
Lozupone, Catherine A. ;
McDonald, Daniel ;
Muegge, Brian D. ;
Pirrung, Meg ;
Reeder, Jens ;
Sevinsky, Joel R. ;
Tumbaugh, Peter J. ;
Walters, William A. ;
Widmann, Jeremy ;
Yatsunenko, Tanya ;
Zaneveld, Jesse ;
Knight, Rob .
NATURE METHODS, 2010, 7 (05) :335-336
[7]  
Deelman E., 2005, Scientific Programming, V13, P219
[8]  
FETTER W, 2014, TECHNOLOGY, V28, P32
[9]   Open software for biologists: from famine to feast [J].
Field, Dawn ;
Tiwari, Bela ;
Booth, Tim ;
Houten, Stewart ;
Swan, Dan ;
Bertrand, Nicolas ;
Thurston, Milo .
NATURE BIOTECHNOLOGY, 2006, 24 (07) :801-803
[10]  
Fielding R., 2002, THESIS