ONIX: An X-ray deep-learning tool for 3D reconstructions from sparse views

被引:1
|
作者
Zhang Y. [1 ]
Yao Z. [1 ]
Ritschel T. [2 ]
Villanueva-Perez P. [1 ]
机构
[1] Synchrotron Radiation Research and NanoLund, Lund University, Lund
[2] Department of Computer Science, University College London, London
来源
Applied Research | 2023年 / 2卷 / 04期
基金
欧盟地平线“2020”;
关键词
3D reconstruction; deep learning; materials science; multi-projection imaging; stereoscopy; X-ray imaging;
D O I
10.1002/appl.202300016
中图分类号
学科分类号
摘要
Time-resolved three-dimensional (3D) X-ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials-science applications in academia and industry. Standard 3D X-ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials-science applications, such as cell-wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X-ray imaging (ONIX), a deep-learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X-ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X-ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging and (ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging. © 2023 The Authors. Applied Research published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 50 条
  • [41] X23D-Intraoperative 3D Lumbar Spine Shape Reconstruction Based on Sparse Multi-View X-ray Data
    Jecklin, Sascha
    Jancik, Carla
    Farshad, Mazda
    Furnstahl, Philipp
    Esfandiari, Hooman
    JOURNAL OF IMAGING, 2022, 8 (10)
  • [42] Registration of 3D Transesophageal Echocardiography and X-Ray Fluoroscopy Using An Inverse Geometry X-Ray System
    Speidel, M.
    Hatt, C.
    Tomkowiak, M.
    Funk, T.
    Raval, A.
    MEDICAL PHYSICS, 2014, 41 (06) : 471 - 471
  • [43] Plug-and-Play Learned Proximal Trajectory for 3D Sparse-View X-Ray Computed Tomography
    Vo, Romain
    Escoda, Julie
    Vienne, Caroline
    Decenciere, Etienne
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 221 - 238
  • [44] 3D X-ray microscopy with a CsPbBr3 nanowire scintillator
    Hanna Dierks
    Zhaojun Zhang
    Nils Lamers
    Jesper Wallentin
    Nano Research, 2023, 16 : 1084 - 1089
  • [45] 3-D reconstruction of the coronary artery tree from multiple views of a rotational X-ray angiography
    Liao, Rui
    Luc, Duong
    Sun, Yiyong
    Kirchberg, Klaus
    INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING, 2010, 26 (07) : 733 - 749
  • [46] 3-D reconstruction of the coronary artery tree from multiple views of a rotational X-ray angiography
    Rui Liao
    Duong Luc
    Yiyong Sun
    Klaus Kirchberg
    The International Journal of Cardiovascular Imaging, 2010, 26 : 733 - 749
  • [47] DPPS: A deep-learning based point-light photometric stereo method for 3D reconstruction of metallic surfaces
    Yang, Ru
    Wang, Yaoke
    Liao, Shuheng
    Guo, Ping
    MEASUREMENT, 2023, 210
  • [48] A novel deep-learning–based approach for automatic reorientation of 3D cardiac SPECT images
    Duo Zhang
    P. Hendrik Pretorius
    Kaixian Lin
    Weibing Miao
    Jingsong Li
    Michael A. King
    Wentao Zhu
    European Journal of Nuclear Medicine and Molecular Imaging, 2021, 48 : 3457 - 3468
  • [49] Deep learning-based X-ray computed tomography image reconstruction and prediction of compression behavior of 3D printed lattice structures
    Yang, Heng
    Wang, Wenfeng
    Li, Chuanlei
    Qi, Junfeng
    Wang, Panding
    Lei, Hongshuai
    Fang, Daining
    ADDITIVE MANUFACTURING, 2022, 54
  • [50] 3D X-ray microscopy with a CsPbBr3 nanowire scintillator
    Dierks, Hanna
    Zhang, Zhaojun
    Lamers, Nils
    Wallentin, Jesper
    NANO RESEARCH, 2023, 16 (01) : 1084 - 1089