ONIX: An X-ray deep-learning tool for 3D reconstructions from sparse views

被引:1
|
作者
Zhang Y. [1 ]
Yao Z. [1 ]
Ritschel T. [2 ]
Villanueva-Perez P. [1 ]
机构
[1] Synchrotron Radiation Research and NanoLund, Lund University, Lund
[2] Department of Computer Science, University College London, London
来源
Applied Research | 2023年 / 2卷 / 04期
基金
欧盟地平线“2020”;
关键词
3D reconstruction; deep learning; materials science; multi-projection imaging; stereoscopy; X-ray imaging;
D O I
10.1002/appl.202300016
中图分类号
学科分类号
摘要
Time-resolved three-dimensional (3D) X-ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials-science applications in academia and industry. Standard 3D X-ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials-science applications, such as cell-wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X-ray imaging (ONIX), a deep-learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X-ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X-ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging and (ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging. © 2023 The Authors. Applied Research published by Wiley-VCH GmbH.
引用
收藏
相关论文
共 50 条
  • [21] Full 3D Microwave Breast Imaging Using a Deep-Learning Technique
    Khoshdel, Vahab
    Asefi, Mohammad
    Ashraf, Ahmed
    LoVetri, Joe
    JOURNAL OF IMAGING, 2020, 6 (08)
  • [22] Perovskite or Not Perovskite? A Deep-Learning Approach to Automatically Identify New Hybrid Perovskites from X-ray Diffraction Patterns
    Massuyeau, Florian
    Broux, Thibault
    Coulet, Florent
    Demessence, Aude
    Mesbah, Adel
    Gautier, Romain
    ADVANCED MATERIALS, 2022, 34 (41)
  • [23] 3D RECONSTRUCTION OF CORONARY ARTERIES FROM ROTATIONAL X-RAY ANGIOGRAPHY
    Oueslati, Chaima
    Mabrouk, Sabra
    Ghorbel, Faouzi
    Bedoui, Mohamed Hedi
    26. INTERNATIONAL CONFERENCE IN CENTRAL EUROPE ON COMPUTER GRAPHICS, VISUALIZATION AND COMPUTER VISION (WSCG 2018), 2018, 2802 : 64 - 69
  • [24] 3D RECONSTRUCTION OF CORONARY ARTERIES FROM ROTATIONAL X-RAY ANGIOGRAPHY
    Cardenes, Ruben
    Novikov, Alexey
    Gunn, Julian
    Hose, Rod
    Frangi, Alejandro F.
    2012 9TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2012, : 618 - 621
  • [25] 3D Measurements from X-ray Images and Dense Surface Mappings
    Albioll, F.
    Corbi, A.
    Albio, A.
    2016 GLOBAL MEDICAL ENGINEERING PHYSICS EXCHANGES/PAN AMERICAN HEALTH CARE EXCHANGES (GMEPE/PAHCE), 2016,
  • [26] Geometrical Calibration of X-Ray Imaging With RGB Cameras for 3D Reconstruction
    Albiol, Francisco
    Corbi, Alberto
    Albiol, Alberto
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (08) : 1952 - 1961
  • [27] Nondestructive 3D phenotyping method of passion fruit based on X-ray micro-computed tomography and deep learning
    Lu, Yuwei
    Wang, Rui
    Hu, Tianyu
    He, Qiang
    Chen, Zhou Shuai
    Wang, Jinhu
    Liu, Lingbo
    Fang, Chuanying
    Luo, Jie
    Fu, Ling
    Yu, Lejun
    Liu, Qian
    FRONTIERS IN PLANT SCIENCE, 2023, 13
  • [28] Feature-Aware Deep-Learning Reconstruction for Context-Sensitive X-ray Computed Tomography
    Matsuura, Masakazu
    Zhou, Jian
    Akino, Naruomi
    Yu, Zhou
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2021, 5 (01) : 99 - 107
  • [29] Deep learning based sparse view x-ray CT reconstruction for checked baggage screening
    Mandava, Sagar
    Ashok, Amit
    Bilgin, Ali
    ANOMALY DETECTION AND IMAGING WITH X-RAYS (ADIX) III, 2018, 10632
  • [30] 3D reconstruction of archaeological artefacts from 2-D X-ray images
    Angheluta, L. M.
    OPTOELECTRONICS AND ADVANCED MATERIALS-RAPID COMMUNICATIONS, 2018, 12 (11-12): : 705 - 712