Image inpainting in acoustic microscopy

被引:1
作者
Banerjee, Pragyan [1 ]
Mishra, Sibasish [2 ]
Yadav, Nitin [2 ]
Agarwal, Krishna [3 ]
Melandso, Frank [3 ]
Prasad, Dilip K. [4 ]
Habib, Anowarul [3 ]
机构
[1] Indian Inst Technol Guwahati, Dept Math, Gauhati 781039, Assam, India
[2] Indian Inst Technol Delhi, Dept Phys, Delhi, India
[3] UiT Arctic Univ Norway, Dept Phys & Technol, N-9037 Tromso, Norway
[4] UiT Arctic Univ Norway, Dept Comp Sci, N-9037 Tromso, Norway
关键词
D O I
10.1063/5.0139034
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
Scanning acoustic microscopy (SAM) is a non-ionizing and label-free imaging modality used to visualize the surface and internal structures of industrial objects and biological specimens. The image of the sample under investigation is created using high-frequency acoustic waves. The frequency of the excitation signals, the signal-to-noise ratio, and the pixel size all play a role in acoustic image resolution. We propose a deep learning-enabled image inpainting for acoustic microscopy in this paper. The method is based on training various generative adversarial networks (GANs) to inpaint holes in the original image and generate a 4x image from it. In this approach, five different types of GAN models are used: AOTGAN, DeepFillv2, Edge-Connect, DMFN, and Hypergraphs image inpainting. The trained model's performance is assessed by calculating the peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) between network-predicted and ground truth images. The Hypergraphs image inpainting model provided an average SSIM of 0.93 for 2x and up to 0.93 for the final 4x, respectively, and a PSNR of 32.33 for 2x and up to 32.20 for the final 4x. The developed SAM and GAN frameworks can be used in a variety of industrial applications, including bio-imaging.
引用
收藏
页数:12
相关论文
共 51 条
  • [21] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [22] Image Inpainting Based on Generative Adversarial Networks
    Jiang, Yi
    Xu, Jiajie
    Yang, Baoqing
    Xu, Jing
    Zhu, Junwu
    [J]. IEEE ACCESS, 2020, 8 (08): : 22884 - 22892
  • [23] Karras T., 2018, PROGR GROWING GANS I, DOI DOI 10.48550/ARXIV.1710.10196
  • [24] Numerical method for tilt compensation in scanning acoustic microscopy
    Kumar, Prakhar
    Yadav, Nitin
    Shamsuzzaman, Muhammad
    Agarwal, Krishna
    Melandso, Frank
    Habib, Anowarul
    [J]. MEASUREMENT, 2022, 187
  • [25] Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
    Ledig, Christian
    Theis, Lucas
    Huszar, Ferenc
    Caballero, Jose
    Cunningham, Andrew
    Acosta, Alejandro
    Aitken, Andrew
    Tejani, Alykhan
    Totz, Johannes
    Wang, Zehan
    Shi, Wenzhe
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 105 - 114
  • [26] Image Inpainting for Irregular Holes Using Partial Convolutions
    Liu, Guilin
    Reda, Fitsum A.
    Shih, Kevin J.
    Wang, Ting-Chun
    Tao, Andrew
    Catanzaro, Bryan
    [J]. COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 89 - 105
  • [27] EdgeConnect: Structure Guided Image Inpainting using Edge Prediction
    Nazeri, Kamyar
    Ng, Eric
    Joseph, Tony
    Qureshi, Faisal Z.
    Ebrahimi, Mehran
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3265 - 3274
  • [28] Edge-Informed Single Image Super-Resolution
    Nazeri, Kamyar
    Thasarathan, Harrish
    Ebrahimi, Mehran
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3275 - 3284
  • [29] Nitzberg M., 1993, Filtering, Segmentation and Depth
  • [30] MSCE: An Edge-Preserving Robust Loss Function for Improving Super-Resolution Algorithms
    Pandey, Ram Krishna
    Saha, Nabagata
    Karmakar, Samarjit
    Ramakrishnan, A. G.
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VI, 2018, 11306 : 566 - 575