OnDA: online data analysis and feedback for serial X-ray imaging

被引:84
作者
Mariani, Valerio [1 ]
Morgan, Andrew [1 ]
Yoon, Chun Hong [2 ,3 ,4 ]
Lane, Thomas J. [4 ]
White, Thomas A. [1 ]
O'Grady, Christopher [4 ]
Kuhn, Manuela [2 ]
Aplin, Steve [1 ]
Koglin, Jason [4 ]
Barty, Anton [1 ]
Chapman, Henry N. [1 ,5 ,6 ]
机构
[1] DESY, Ctr Free Electron Laser Sci, Notkestr 85, D-22607 Hamburg, Germany
[2] DESY, Notkestr 85, D-22607 Hamburg, Germany
[3] European XFEL GmbH, Albert Einstein Ring 19, D-22761 Hamburg, Germany
[4] SLAC Natl Accelerator Lab, Linac Coherent Light Source, 2575 Sand Hill Rd, Menlo Pk, CA 94025 USA
[5] Univ Hamburg, Dept Phys, Luruper Chaussee 149, D-22761 Hamburg, Germany
[6] Ctr Ultrafast Imaging, Luruper Chaussee 149, D-22761 Hamburg, Germany
关键词
online data analysis; free-electron lasers; serial femtosecond crystallography; computer programs; DIFFRACTION; SOFTWARE;
D O I
10.1107/S1600576716007469
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This article describes a free and open-source data analysis utility designed for fast online feedback during serial X-ray diffraction and scattering experiments: OnDA (online data analysis). Three complete real-time monitors for common types of serial X-ray imaging experiments are presented. These monitors are capable of providing the essential information required for quick decision making in the face of extreme rates of data collection. In addition, a set of modules, functions and algorithms that allow developers to modify the provided monitors or develop new ones are provided. The emphasis here is on simple, modular and scalable code that is based on open-source libraries and protocols. OnDA monitors have already proven to be invaluable tools in several experiments, especially for scoring and monitoring of diffraction data during serial crystallography experiments at both free-electron laser and synchrotron facilities. It is felt that in the future the kind of fast feedback that OnDA monitors provide will help researchers to deal with the expected very high throughput data flow at next-generation facilities such as the European X-ray free-electron laser.
引用
收藏
页码:1073 / 1080
页数:8
相关论文
共 24 条
[1]  
Altarelli M., 2006, Technical design report
[2]  
[Anonymous], HIER DAT FORM VERS 5
[3]   Time-resolved protein nanocrystallography using an X-ray free-electron laser [J].
Aquila, Andrew ;
Hunter, Mark S. ;
Doak, R. Bruce ;
Kirian, Richard A. ;
Fromme, Petra ;
White, Thomas A. ;
Andreasson, Jakob ;
Arnlund, David ;
Bajt, Sasa ;
Barends, Thomas R. M. ;
Barthelmess, Miriam ;
Bogan, Michael J. ;
Bostedt, Christoph ;
Bottin, Herve ;
Bozek, John D. ;
Caleman, Carl ;
Coppola, Nicola ;
Davidsson, Jan ;
DePonte, Daniel P. ;
Elser, Veit ;
Epp, Sascha W. ;
Erk, Benjamin ;
Fleckenstein, Holger ;
Foucar, Lutz ;
Frank, Matthias ;
Fromme, Raimund ;
Graafsma, Heinz ;
Grotjohann, Ingo ;
Gumprecht, Lars ;
Hajdu, Janos ;
Hampton, Christina Y. ;
Hartmann, Andreas ;
Hartmann, Robert ;
Hauriege, Stefan ;
Hauser, Guenter ;
Hirsemann, Helmut ;
Holl, Peter ;
Holton, James M. ;
Hoemke, Andre ;
Johansson, Linda ;
Kimmel, Nils ;
Kassemeyer, Stephan ;
Krasniqi, Faton ;
Kuehnel, Kaiuwe ;
Liang, Mengning ;
Lomb, Lukas ;
Malmerberg, Erik ;
Marchesini, Stefano ;
Martin, Andrew V. ;
Maia, Filipe R. N. C. .
OPTICS EXPRESS, 2012, 20 (03) :2706-2716
[4]   Cheetah: software for high-throughput reduction and analysis of serial femtosecond X-ray diffraction data [J].
Barty, Anton ;
Kirian, Richard A. ;
Maia, Filipe R. N. C. ;
Hantke, Max ;
Yoon, Chun Hong ;
White, Thomas A. ;
Chapman, Henry .
JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2014, 47 :1118-1131
[5]  
Bernstein H. J., 2006, INT TABLES CRYSTALLO, VG, P37
[6]   Single particle X-ray diffractive imaging [J].
Bogan, Michael J. ;
Benner, W. Henry ;
Boutet, Sebastien ;
Rohner, Urs ;
Frank, Matthias ;
Barty, Anton ;
Seibert, M. Marvin ;
Maia, Filipe ;
Marchesini, Stefano ;
Bajt, Sasa ;
Woods, Bruce ;
Riot, Vincent ;
Hau-Riege, Stefan P. ;
Svenda, Martin ;
Marklund, Erik ;
Spiller, Eberhard ;
Hajdu, Janos ;
Chapman, Henry N. .
NANO LETTERS, 2008, 8 (01) :310-316
[7]   Femtosecond X-ray protein nanocrystallography [J].
Chapman, Henry N. ;
Fromme, Petra ;
Barty, Anton ;
White, Thomas A. ;
Kirian, Richard A. ;
Aquila, Andrew ;
Hunter, Mark S. ;
Schulz, Joachim ;
DePonte, Daniel P. ;
Weierstall, Uwe ;
Doak, R. Bruce ;
Maia, Filipe R. N. C. ;
Martin, Andrew V. ;
Schlichting, Ilme ;
Lomb, Lukas ;
Coppola, Nicola ;
Shoeman, Robert L. ;
Epp, Sascha W. ;
Hartmann, Robert ;
Rolles, Daniel ;
Rudenko, Artem ;
Foucar, Lutz ;
Kimmel, Nils ;
Weidenspointner, Georg ;
Holl, Peter ;
Liang, Mengning ;
Barthelmess, Miriam ;
Caleman, Carl ;
Boutet, Sebastien ;
Bogan, Michael J. ;
Krzywinski, Jacek ;
Bostedt, Christoph ;
Bajt, Sasa ;
Gumprecht, Lars ;
Rudek, Benedikt ;
Erk, Benjamin ;
Schmidt, Carlo ;
Hoemke, Andre ;
Reich, Christian ;
Pietschner, Daniel ;
Strueder, Lothar ;
Hauser, Guenter ;
Gorke, Hubert ;
Ullrich, Joachim ;
Herrmann, Sven ;
Schaller, Gerhard ;
Schopper, Florian ;
Soltau, Heike ;
Kuehnel, Kai-Uwe ;
Messerschmidt, Marc .
NATURE, 2011, 470 (7332) :73-U81
[8]   Parallel distributed computing using Python']Python [J].
Dalcin, Lisandro D. ;
Paz, Rodrigo R. ;
Kler, Pablo A. ;
Cosimo, Alejandro .
ADVANCES IN WATER RESOURCES, 2011, 34 (09) :1124-1139
[9]   Linac Coherent Light Source data analysis using psana [J].
Damiani, D. ;
Dubrovin, M. ;
Gaponenko, I. ;
Kroeger, W. ;
Lane, T. J. ;
Mitra, A. ;
O'Grady, C. P. ;
Salnikov, A. ;
Sanchez-Gonzalez, A. ;
Schneider, D. ;
Yoon, C. H. .
JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2016, 49 :672-679
[10]   Hummingbird: monitoring and analyzing flash X-ray imaging experiments in real time [J].
Daurer, Benedikt J. ;
Hantke, Max F. ;
Nettelblad, Carl ;
Maia, Filipe R. N. C. .
JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2016, 49 :1042-1047