Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning

被引:63
|
作者
Hagita, Katsumi [1 ]
Higuchi, Takeshi [2 ]
Jinnai, Hiroshi [2 ]
机构
[1] Natl Def Acad, Dept Appl Phys, Yokosuka, Kanagawa 2398686, Japan
[2] Tohoku Univ, Inst Multidisciplinary Res Adv Mat, Aoba Ku, 2-1-1 Katahira, Sendai, Miyagi 9808577, Japan
来源
SCIENTIFIC REPORTS | 2018年 / 8卷
关键词
ELECTRON TOMOGRAPHY; NEURAL-NETWORKS; SYSTEMS;
D O I
10.1038/s41598-018-24330-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano-and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Inverse renormalization group based on image super-resolution using deep convolutional networks
    Shiina, Kenta
    Mori, Hiroyuki
    Tomita, Yusuke
    Lee, Hwee Kuan
    Okabe, Yutaka
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [22] Enhancing hyperspectral image compression using learning-based super-resolution technique
    Mohand Ouahioune
    Soltane Ameur
    Mourad Lahdir
    Earth Science Informatics, 2021, 14 : 1173 - 1183
  • [23] Enhancing hyperspectral image compression using learning-based super-resolution technique
    Ouahioune, Mohand
    Ameur, Soltane
    Lahdir, Mourad
    EARTH SCIENCE INFORMATICS, 2021, 14 (03) : 1173 - 1183
  • [24] Assessing the prospects for robust sub-diffraction limited super-resolution imaging with deep neural networks
    Nieuwenhuizen, Robert P. J.
    Bouwman, Dennis D.
    Schutte, Klamer
    EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE III; AND UNMANNED SENSORS, SYSTEMS, AND COUNTERMEASURES, 2018, 10799
  • [25] Enhancing SRTM digital elevation models with deep-learning-based super-resolution image generation
    Moreira, Leonardo Assumpcao
    Poelking, Livia Moreira
    Araki, Hideo
    BOLETIM DE CIENCIAS GEODESICAS, 2022, 28 (04):
  • [26] Super-resolution macroscopic imaging via unknown speckle illumination using sparse aperture transmitter
    Tang, Lisha
    Wei, Weilong
    Xie, Zongliang
    Ma, Haotong
    Qin, Yingxiong
    Ren, Ge
    OPTICS COMMUNICATIONS, 2024, 551
  • [27] Frozen non-equilibrium structure for anisotropically deformed natural rubber with nanomatrix structure observed by 3D FIB-SEM and electron tomography
    Lina Fukuhara
    Kenichiro Kosugi
    Yoshimasa Yamamoto
    Hiroshi Jinnai
    Hideo Nishioka
    Hiroyuki Ishii
    Masao Fukuda
    Seiichi Kawahara
    Colloid and Polymer Science, 2015, 293 : 2555 - 2563
  • [28] Frozen non-equilibrium structure for anisotropically deformed natural rubber with nanomatrix structure observed by 3D FIB-SEM and electron tomography
    Fukuhara, Lina
    Kosugi, Kenichiro
    Yamamoto, Yoshimasa
    Jinnai, Hiroshi
    Nishioka, Hideo
    Ishii, Hiroyuki
    Fukuda, Masao
    Kawahara, Seiichi
    COLLOID AND POLYMER SCIENCE, 2015, 293 (09) : 2555 - 2563
  • [29] MegaFlow2D: A Parametric Dataset for Machine Learning Super-resolution in Computational Fluid Dynamics Simulations
    Xu, Wenzhuo
    Gutierrez, Noelia Grande
    McComb, Christopher
    2023 CYBER-PHYSICAL SYSTEMS AND INTERNET-OF-THINGS WEEK, CPS-IOT WEEK WORKSHOPS, 2023, : 100 - 104
  • [30] Combined multi-plane phase retrieval and super-resolution optical fluctuation imaging for 4D cell microscopy
    Descloux, A.
    Grussmayer, K. S.
    Bostan, E.
    Lukes, T.
    Bouwens, A.
    Sharipov, A.
    Geissbuehler, S.
    Mahul-Mellier, A. -L.
    Lashuel, H. A.
    Leutenegger, M.
    Lasser, T.
    NATURE PHOTONICS, 2018, 12 (03) : 165 - +