ONIX: An X-ray deep-learning tool for 3D reconstructions from sparse views

被引:1
|
作者
Zhang Y. [1 ]
Yao Z. [1 ]
Ritschel T. [2 ]
Villanueva-Perez P. [1 ]
机构
[1] Synchrotron Radiation Research and NanoLund, Lund University, Lund
[2] Department of Computer Science, University College London, London
来源
Applied Research | 2023年 / 2卷 / 04期
基金
欧盟地平线“2020”;
关键词
3D reconstruction; deep learning; materials science; multi-projection imaging; stereoscopy; X-ray imaging;
D O I
10.1002/appl.202300016
中图分类号
学科分类号
摘要
Time-resolved three-dimensional (3D) X-ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials-science applications in academia and industry. Standard 3D X-ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials-science applications, such as cell-wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X-ray imaging (ONIX), a deep-learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X-ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X-ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging and (ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging. © 2023 The Authors. Applied Research published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 50 条
  • [31] Neural 3D reconstruction from sparse views using geometric priors
    Mu, Tai-Jiang
    Chen, Hao-Xiang
    Cai, Jun-Xiong
    Guo, Ning
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (04) : 687 - 697
  • [32] Neural 3D reconstruction from sparse views using geometric priors
    Tai-Jiang Mu
    Hao-Xiang Chen
    Jun-Xiong Cai
    Ning Guo
    Computational Visual Media, 2023, 9 : 687 - 697
  • [33] X-ray polycapillary characterization and 3D imaging properties
    Hampai, Dariush
    Cappuccio, Giorgio
    Cibin, Giannantonio
    Dabagov, Sultan B.
    Sessa, Vito
    INTERNATIONAL CONFERENCE ON CHARGED AND NEUTRAL PARTICLES CHANNELING PHENOMENA II - CHANNELING 2006, 2007, 6634
  • [34] X-ray method takes a 3D fingerprint of materials
    Chamard, Virginie
    NATURE, 2024,
  • [35] Glowing nanocrystals enable 3D X-ray imaging
    Albano N. Carneiro Neto
    Oscar L. Malta
    Nature, 2021, 590 : 396 - 397
  • [36] A Deep-Learning Approach for Wideband Design of 3D TSV-Based Inductors
    Li, Xiangliang
    Zhao, Peng
    Chen, Shichang
    Xu, Kuiwen
    Wang, Gaofeng
    IEEE ACCESS, 2022, 10 : 133673 - 133681
  • [37] 3D Scanning Coherent X-ray Microscopy at PtyNAMi
    Schropp, Andreas
    Achilles, Silvio
    Patjens, Svenja
    Seiboth, Frank
    Stuckelberger, Michael E.
    Jiang, Zhimin
    Pikul, James H.
    Schroer, Christian G.
    DEVELOPMENTS IN X-RAY TOMOGRAPHY XIV, 2022, 12242
  • [38] BX2S-Net: Learning to reconstruct 3D spinal structures from bi-planar X-ray images
    Chen, Zheye
    Guo, Lijun
    Zhang, Rong
    Fang, Zhongding
    He, Xiuchao
    Wang, Jianhua
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 154
  • [39] 3DSRNet: 3-D Spine Reconstruction Network Using 2-D Orthogonal X-Ray Images Based on Deep Learning
    Gao, Yuan
    Tang, Hui
    Ge, Rongjun
    Liu, Jin
    Chen, Xin
    Xi, Yan
    Ji, Xu
    Shu, Huazhong
    Zhu, Jian
    Coatrieux, Gouenou
    Coatrieux, Jean-Louis
    Chen, Yang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [40] Deep learning-based X-ray inpainting for improving spinal 2D-3D registration
    Esfandiari, Hooman
    Weidert, Simon
    Koeveshazi, Istvan
    Anglin, Carolyn
    Street, John
    Hodgson, Antony J.
    INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2021, 17 (02)