Three-dimensional coherent X-ray diffraction imaging via deep convolutional neural networks

被引:36
作者
Wu, Longlong [1 ,2 ]
Yoo, Shinjae [1 ]
Suzana, Ana F. [2 ]
Assefa, Tadesse A. [2 ,3 ]
Diao, Jiecheng [4 ]
Harder, Ross J. [5 ]
Cha, Wonsuk [5 ]
Robinson, Ian K. [2 ,4 ]
机构
[1] Brookhaven Natl Lab, Computat Sci Initiat, Upton, NY 11973 USA
[2] Brookhaven Natl Lab, Condensed Matter Phys & Mat Sci Dept, Upton, NY 11973 USA
[3] SLAC Natl Accelerator Lab, Stanford Inst Mat & Energy Sci, Menlo Pk, CA USA
[4] UCL, London Ctr Nanotechnol, London, England
[5] Adv Photon Source, Argonne, IL USA
基金
英国工程与自然科学研究理事会; 美国国家科学基金会;
关键词
PHASE RETRIEVAL; DYNAMICS; STRAIN; ALGORITHM;
D O I
10.1038/s41524-021-00644-z
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
As a critical component of coherent X-ray diffraction imaging (CDI), phase retrieval has been extensively applied in X-ray structural science to recover the 3D morphological information inside measured particles. Despite meeting all the oversampling requirements of Sayre and Shannon, current phase retrieval approaches still have trouble achieving a unique inversion of experimental data in the presence of noise. Here, we propose to overcome this limitation by incorporating a 3D Machine Learning (ML) model combining (optional) supervised learning with transfer learning. The trained ML model can rapidly provide an immediate result with high accuracy which could benefit real-time experiments, and the predicted result can be further refined with transfer learning. More significantly, the proposed ML model can be used without any prior training to learn the missing phases of an image based on minimization of an appropriate 'loss function' alone. We demonstrate significantly improved performance with experimental Bragg CDI data over traditional iterative phase retrieval algorithms.
引用
收藏
页数:8
相关论文
共 46 条
[1]  
Ayachit U., 2015, The ParaView Guide: Updated for ParaView Version 4.3
[2]   Ultrafast single-shot diffraction imaging of nanoscale dynamics [J].
Barty, Anton ;
Boutet, Sebastien ;
Bogan, Michael J. ;
Hau-Riege, Stefan ;
Marchesini, Stefano ;
Sokolowski-Tinten, Klaus ;
Stojanovic, Nikola ;
Tobey, Ra'Anan ;
Ehrke, Henri ;
Cavalleri, Andrea ;
Duesterer, Stefan ;
Frank, Matthias ;
Bajt, Sasa ;
Woods, Bruce W. ;
Seibert, M. Marvin ;
Hajdu, Janos ;
Treusch, Rolf ;
Chapman, Henry N. .
NATURE PHOTONICS, 2008, 2 (07) :415-419
[3]   UNIQUENESS OF SOLUTIONS TO TWO-DIMENSIONAL FOURIER PHASE PROBLEMS FOR LOCALIZED AND POSITIVE IMAGES [J].
BATES, RHT .
COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1984, 25 (02) :205-217
[4]   Phase retrieval, error reduction algorithm, and Fienup variants: a view from convex optimization [J].
Bauschke, HH ;
Combettes, PL ;
Luke, DR .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2002, 19 (07) :1334-1345
[5]   Perspectives on single particle imaging with x rays at the advent of high repetition rate x-ray free electron laser sources [J].
Bielecki, Johan ;
Maia, Filipe R. N. C. ;
Mancuso, Adrian P. .
STRUCTURAL DYNAMICS-US, 2020, 7 (04)
[6]   Femtosecond diffractive imaging with a soft-X-ray free-electron laser [J].
Chapman, Henry N. ;
Barty, Anton ;
Bogan, Michael J. ;
Boutet, Sebastien ;
Frank, Matthias ;
Hau-Riege, Stefan P. ;
Marchesini, Stefano ;
Woods, Bruce W. ;
Bajt, Sasa ;
Benner, Henry ;
London, Richard A. ;
Ploenjes, Elke ;
Kuhlmann, Marion ;
Treusch, Rolf ;
Duesterer, Stefan ;
Tschentscher, Thomas ;
Schneider, Jochen R. ;
Spiller, Eberhard ;
Moeller, Thomas ;
Bostedt, Christoph ;
Hoener, Matthias ;
Shapiro, David A. ;
Hodgson, Keith O. ;
Van der Spoel, David ;
Burmeister, Florian ;
Bergh, Magnus ;
Caleman, Carl ;
Huldt, Goesta ;
Seibert, M. Marvin ;
Maia, Filipe R. N. C. ;
Lee, Richard W. ;
Szoeke, Abraham ;
Timneanu, Nicusor ;
Hajdu, Janos .
NATURE PHYSICS, 2006, 2 (12) :839-843
[7]   Coherent lensless X-ray imaging [J].
Chapman, Henry N. ;
Nugent, Keith A. .
NATURE PHOTONICS, 2010, 4 (12) :833-839
[8]   Real-time coherent diffraction inversion using deep generative networks [J].
Cherukara, Mathew J. ;
Nashed, Youssef S. G. ;
Harder, Ross J. .
SCIENTIFIC REPORTS, 2018, 8
[9]   Ultrafast Three-Dimensional Imaging of Lattice Dynamics in Individual Gold Nanocrystals [J].
Clark, J. N. ;
Beitra, L. ;
Xiong, G. ;
Higginbotham, A. ;
Fritz, D. M. ;
Lemke, H. T. ;
Zhu, D. ;
Chollet, M. ;
Williams, G. J. ;
Messerschmidt, M. ;
Abbey, B. ;
Harder, R. J. ;
Korsunsky, A. M. ;
Wark, J. S. ;
Robinson, I. K. .
SCIENCE, 2013, 341 (6141) :56-59
[10]   A MHz-repetition-rate hard X-ray free-electron laser driven by a superconducting linear accelerator [J].
Decking, W. ;
Abeghyan, S. ;
Abramian, P. ;
Abramsky, A. ;
Aguirre, A. ;
Albrecht, C. ;
Alou, P. ;
Altarelli, M. ;
Altmann, P. ;
Amyan, K. ;
Anashin, V ;
Apostolov, E. ;
Appel, K. ;
Auguste, D. ;
Ayvazyan, V ;
Baark, S. ;
Babies, F. ;
Baboi, N. ;
Bak, P. ;
Balandin, V ;
Baldinger, R. ;
Baranasic, B. ;
Barbanotti, S. ;
Belikov, O. ;
Belokurov, V ;
Belova, L. ;
Belyakov, V ;
Berry, S. ;
Bertucci, M. ;
Beutner, B. ;
Block, A. ;
Bloecher, M. ;
Boeckmann, T. ;
Bohm, C. ;
Boehnert, M. ;
Bondar, V ;
Bondarchuk, E. ;
Bonezzi, M. ;
Borowiec, P. ;
Boesch, C. ;
Boesenberg, U. ;
Bosotti, A. ;
Boespflug, R. ;
Bousonville, M. ;
Boyd, E. ;
Bozhko, Y. ;
Brand, A. ;
Branlard, J. ;
Briechle, S. ;
Brinker, F. .
NATURE PHOTONICS, 2020, 14 (06) :391-+