Optimization of tomographic reconstruction workflows on geographically distributed resources

被引:8
作者
Bicer, Tekin [1 ]
Gursoy, Doga [2 ]
Kettimuthu, Rajkumar [1 ,3 ,4 ]
De Carlo, Francesco [2 ]
Foster, Ian T. [1 ,3 ,4 ,5 ]
机构
[1] Argonne Natl Lab, Math & Comp Sci Div, Argonne, IL 60439 USA
[2] Argonne Natl Lab, Xray Sci Div, Adv Photon Source, Argonne, IL 60439 USA
[3] Univ Chicago, Computat Inst, Chicago, IL 60637 USA
[4] Argonne Natl Lab, Argonne, IL 60439 USA
[5] Univ Chicago, Dept Comp Sci, Chicago, IL 60637 USA
关键词
tomography; scientific workflows; performance modeling; IMAGE-RECONSTRUCTION; ITERATIVE RECONSTRUCTION; SOFTWARE; STORAGE;
D O I
10.1107/S1600577516007980
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
New technological advancements in synchrotron light sources enable data acquisitions at unprecedented levels. This emergent trend affects not only the size of the generated data but also the need for larger computational resources. Although beamline scientists and users have access to local computational resources, these are typically limited and can result in extended execution times. Applications that are based on iterative processing as in tomographic reconstruction methods require high-performance compute clusters for timely analysis of data. Here, time-sensitive analysis and processing of Advanced Photon Source data on geographically distributed resources are focused on. Two main challenges are considered: (i) modeling of the performance of tomographic reconstruction workflows and (ii) transparent execution of these workflows on distributed resources. For the former, three main stages are considered: (i) data transfer between storage and computational resources, (i) wait/queue time of reconstruction jobs at compute resources, and (iii) computation of reconstruction tasks. These performance models allow evaluation and estimation of the execution time of any given iterative tomographic reconstruction workflow that runs on geographically distributed resources. For the latter challenge, a workflow management system is built, which can automate the execution of workflows and minimize the user interaction with the underlying infrastructure. The system utilizes Globus to perform secure and efficient data transfer operations. The proposed models and the workflow management system are evaluated by using three high-performance computing and two storage resources, all of which are geographically distributed. Workflows were created with different computational requirements using two compute-intensive tomographic reconstruction algorithms. Experimental evaluation shows that the proposed models and system can be used for selecting the optimum resources, which in turn can provide up to 3.13x speedup (on experimented resources). Moreover, the error rates of the models range between 2.1 and 23.3% (considering workflow execution times), where the accuracy of the model estimations increases with higher computational demands in reconstruction tasks.
引用
收藏
页码:997 / 1005
页数:9
相关论文
共 36 条
[1]   Fast tomographic reconstruction on multicore computers [J].
Agulleiro, J. I. ;
Fernandez, J. J. .
BIOINFORMATICS, 2011, 27 (04) :582-583
[2]   Software as a Service for Data Scientists [J].
Allen, Bryce ;
Bresnahan, John ;
Childers, Lisa ;
Foster, Ian ;
Kandaswamy, Gopi ;
Kettimuthu, Raj ;
Kordas, Jack ;
Link, Mike ;
Martin, Stuart ;
Pickett, Karl ;
Tuecke, Steven .
COMMUNICATIONS OF THE ACM, 2012, 55 (02) :81-88
[3]  
APS, 2015, TECHNICAL REPORT
[4]   Data Analysis WorkbeNch (DAWN) [J].
Basham, Mark ;
Filik, Jacob ;
Wharmby, Michael T. ;
Chang, Peter C. Y. ;
El Kassaby, Baha ;
Gerring, Matthew ;
Aishima, Jun ;
Levik, Karl ;
Pulford, Bill C. A. ;
Sikharulidze, Irakli ;
Sneddon, Duncan ;
Webber, Matthew ;
Dhesi, Sarnjeet S. ;
Maccherozzi, Francesco ;
Svensson, Olof ;
Brockhauser, Sandor ;
Naray, Gabor ;
Ashton, Alun W. .
JOURNAL OF SYNCHROTRON RADIATION, 2015, 22 :853-858
[5]   Iterative reconstruction methods in X-ray CT [J].
Beister, Marcel ;
Kolditz, Daniel ;
Kalender, Willi A. .
PHYSICA MEDICA-EUROPEAN JOURNAL OF MEDICAL PHYSICS, 2012, 28 (02) :94-108
[6]  
Bicarregui Juan, 2015, Synchrotron Radiation News, V28, P30, DOI 10.1080/08940886.2015.1013418
[7]   Rapid Tomographic Image Reconstruction via Large-Scale Parallelization [J].
Bicer, Tekin ;
Gursoy, Doga ;
Kettimuthu, Rajkumar ;
De Carlo, Francesco ;
Agrawal, Gagan ;
Foster, Ian T. .
EURO-PAR 2015: PARALLEL PROCESSING, 2015, 9233 :289-302
[8]   Enhanced and Flexible Software Tools for X-ray Computed Tomography at the Italian Synchrotron Radiation Facility Elettra [J].
Brun, Francesco ;
Pacile, Serena ;
Accardo, Agostino ;
Kourousias, George ;
Dreossi, Diego ;
Mancini, Lucia ;
Tromba, Giuliana ;
Pugliese, Roberto .
FUNDAMENTA INFORMATICAE, 2015, 141 (2-3) :233-243
[9]   PITRE: software for phase-sensitive X-ray image processing and tomography reconstruction [J].
Chen, Rong-Chang ;
Dreossi, Diego ;
Mancini, Lucia ;
Menk, Ralf ;
Rigon, Luigi ;
Xiao, Ti-Qiao ;
Longo, Renata .
JOURNAL OF SYNCHROTRON RADIATION, 2012, 19 :836-845
[10]  
Chilingaryan S., 2010, 17 IEEE NPSS REAL TI, P1