Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning

被引:63
作者
Hagita, Katsumi [1 ]
Higuchi, Takeshi [2 ]
Jinnai, Hiroshi [2 ]
机构
[1] Natl Def Acad, Dept Appl Phys, Yokosuka, Kanagawa 2398686, Japan
[2] Tohoku Univ, Inst Multidisciplinary Res Adv Mat, Aoba Ku, 2-1-1 Katahira, Sendai, Miyagi 9808577, Japan
来源
SCIENTIFIC REPORTS | 2018年 / 8卷
关键词
ELECTRON TOMOGRAPHY; NEURAL-NETWORKS; SYSTEMS;
D O I
10.1038/s41598-018-24330-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano-and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Action Recognition Using High Temporal Resolution 3D Neural Network Based on Dilated Convolution
    Xu, Yongyang
    Feng, Yaxing
    Xie, Zhong
    Xie, Mingyu
    Luo, Wei
    IEEE ACCESS, 2020, 8 : 165365 - 165372
  • [42] Automatic Segmentation and Scoring of 3D in Vitro Skin Models Using Deep Learning Methods
    Hertlein, Anna-Sophia
    Wussmann, Maximiliane
    Boche, Benjamin
    Pracht, Felix
    Holzer, Siegfried
    Groeber-Becker, Florian
    Wesarg, Stefan
    DIGITAL AND COMPUTATIONAL PATHOLOGY, MEDICAL IMAGING 2024, 2024, 12933
  • [43] 3D Human Pose Estimation from RGB-D Images Using Deep Learning Method
    Chun, Junchul
    Park, Seohee
    Ji, Myunggeun
    2018 INTERNATIONAL CONFERENCE ON SENSORS, SIGNAL AND IMAGE PROCESSING (SSIP 2018), 2018, : 51 - 55
  • [44] AutoPhaseNN: unsupervised physics-aware deep learning of 3D nanoscale Bragg coherent diffraction imaging
    Yao, Yudong
    Chan, Henry
    Sankaranarayanan, Subramanian
    Balaprakash, Prasanna
    Harder, Ross J.
    Cherukara, Mathew J.
    NPJ COMPUTATIONAL MATERIALS, 2022, 8 (01)
  • [45] Violent Human Behaviour Detection in Videos Using ResNet18 3D Deep Learning
    T. M. Praneeth Naidu
    P. Chandra Sekhar
    Pradeep Kumar Boya
    SN Computer Science, 5 (7)
  • [46] Integrating real-time multi-resolution scanning and machine learning for Conformal Robotic 3D Printing in Architecture
    Nicholas, Paul
    Rossi, Gabriella
    Williams, Ella
    Bennett, Michael
    Schork, Tim
    INTERNATIONAL JOURNAL OF ARCHITECTURAL COMPUTING, 2020, 18 (04) : 371 - 384
  • [47] Automated age estimation of young individuals based on 3D knee MRI using deep learning
    Mauer, Markus Auf der
    Well, Eilin Jopp-van
    Herrmann, Jochen
    Groth, Michael
    Morlock, Michael M.
    Maas, Rainer
    Saeing, Dennis
    INTERNATIONAL JOURNAL OF LEGAL MEDICINE, 2021, 135 (02) : 649 - 663
  • [48] F2S3: Robustified determination of 3D displacement vector fields using deep learning
    Gojcic, Zan
    Zhou, Caifa
    Wieser, Andreas
    JOURNAL OF APPLIED GEODESY, 2020, 14 (02) : 177 - 189
  • [49] High-resolution high-sensitivity elemental imaging by secondary ion mass spectrometry: from traditional 2D and 3D imaging to correlative microscopy
    Wirtz, T.
    Philipp, P.
    Audinot, J-N
    Dowsett, D.
    Eswara, S.
    NANOTECHNOLOGY, 2015, 26 (43)
  • [50] Deep-learning-enabled temporally super-resolved multiplexed fringe projection profilometry: high-speed kHz 3D imaging with low-speed camera
    Chen, Wenwu
    Feng, Shijie
    Yin, Wei
    Li, Yixuan
    Qian, Jiaming
    Chen, Qian
    Zuo, Chao
    PHOTONIX, 2024, 5 (01)