ONIX: An X-ray deep-learning tool for 3D reconstructions from sparse views

被引:1
|
作者
Zhang Y. [1 ]
Yao Z. [1 ]
Ritschel T. [2 ]
Villanueva-Perez P. [1 ]
机构
[1] Synchrotron Radiation Research and NanoLund, Lund University, Lund
[2] Department of Computer Science, University College London, London
来源
Applied Research | 2023年 / 2卷 / 04期
基金
欧盟地平线“2020”;
关键词
3D reconstruction; deep learning; materials science; multi-projection imaging; stereoscopy; X-ray imaging;
D O I
10.1002/appl.202300016
中图分类号
学科分类号
摘要
Time-resolved three-dimensional (3D) X-ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials-science applications in academia and industry. Standard 3D X-ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials-science applications, such as cell-wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X-ray imaging (ONIX), a deep-learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X-ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X-ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging and (ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging. © 2023 The Authors. Applied Research published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 50 条
  • [1] Deep learning-based 2D/3D registration of an atlas to biplanar X-ray images
    Jeroen Van Houtte
    Emmanuel Audenaert
    Guoyan Zheng
    Jan Sijbers
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 1333 - 1342
  • [2] Deep learning-based 2D/3D registration of an atlas to biplanar X-ray images
    Van Houtte, Jeroen
    Audenaert, Emmanuel
    Zheng, Guoyan
    Sijbers, Jan
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (07) : 1333 - 1342
  • [3] Urban object classification with 3D Deep-Learning
    Zegaoui, Younes
    Chaumont, Marc
    Subsol, Gerard
    Borianne, Philippe
    Derras, Mustapha
    2019 JOINT URBAN REMOTE SENSING EVENT (JURSE), 2019,
  • [4] Deep learning-based hybrid reconstruction algorithm for fibre instance segmentation from 3D x-ray tomographic images
    Fang, Mengqi
    Sibellas, Aurelien
    Drummond, James
    Cao, Yankai
    Phillion, Andre
    Martinez, Mark
    Pediredla, Vijay Kumar
    Gopaluni, Bhushan
    CANADIAN JOURNAL OF CHEMICAL ENGINEERING, 2023, 101 (12) : 6817 - 6826
  • [5] Hip Fracture Discrimination using 3D Reconstructions from Dual-energy X-ray Absorptiometry
    Whitmarsh, Tristan
    Fritscher, Karl D.
    Humbert, Ludovic
    Del-Rio-Barquero, Luis M.
    Schubert, Rainer
    Frangi, Alejandro F.
    2011 8TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2011, : 1189 - 1192
  • [6] Calibration of X-ray projections in 3D reconstruction
    Wang, P
    Mou, XQ
    Qin, ZY
    Cai, YL
    VISUALIZATION AND OPTIMIZATION TECHNIQUES, 2001, 4553 : 44 - 49
  • [7] Deep-learning map segmentation for protein X-ray crystallographic structure determination
    Skuba, Pavol
    ACTA CRYSTALLOGRAPHICA SECTION D-STRUCTURAL BIOLOGY, 2024, 80 : 528 - 534
  • [8] Enhancing deep-learning training for phase identification in powder X-ray diffractograms
    Schuetzke, Jan
    Benedix, Alexander
    Mikut, Ralf
    Reischl, Markus
    IUCRJ, 2021, 8 : 408 - 420
  • [9] Assessing Electronics with Advanced 3D X-ray Imaging Techniques, Nanoscale Tomography, and Deep Learning
    Villarraga-Gomez, Herminso
    Crosby, Kyle
    Terada, Masako
    Rad, Mansoureh Norouzi
    JOURNAL OF FAILURE ANALYSIS AND PREVENTION, 2024, 24 (05) : 2113 - 2128
  • [10] Automated Void Detection in TSVs from 2D X-Ray Scans using Supervised Learning with 3D X-Ray Scans
    Pahwa, Ramanpreet Singh
    Gopalakrishnan, Saisubramaniam
    Su, Huang
    Ping, Ong Ee
    Dai, Haiwen
    Wee, David Ho Soon
    Qin, Ren
    Rao, Vempati Srinivasa
    IEEE 71ST ELECTRONIC COMPONENTS AND TECHNOLOGY CONFERENCE (ECTC 2021), 2021, : 842 - 849