Image inpainting in acoustic microscopy

被引:1
作者
Banerjee, Pragyan [1 ]
Mishra, Sibasish [2 ]
Yadav, Nitin [2 ]
Agarwal, Krishna [3 ]
Melandso, Frank [3 ]
Prasad, Dilip K. [4 ]
Habib, Anowarul [3 ]
机构
[1] Indian Inst Technol Guwahati, Dept Math, Gauhati 781039, Assam, India
[2] Indian Inst Technol Delhi, Dept Phys, Delhi, India
[3] UiT Arctic Univ Norway, Dept Phys & Technol, N-9037 Tromso, Norway
[4] UiT Arctic Univ Norway, Dept Comp Sci, N-9037 Tromso, Norway
关键词
D O I
10.1063/5.0139034
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
Scanning acoustic microscopy (SAM) is a non-ionizing and label-free imaging modality used to visualize the surface and internal structures of industrial objects and biological specimens. The image of the sample under investigation is created using high-frequency acoustic waves. The frequency of the excitation signals, the signal-to-noise ratio, and the pixel size all play a role in acoustic image resolution. We propose a deep learning-enabled image inpainting for acoustic microscopy in this paper. The method is based on training various generative adversarial networks (GANs) to inpaint holes in the original image and generate a 4x image from it. In this approach, five different types of GAN models are used: AOTGAN, DeepFillv2, Edge-Connect, DMFN, and Hypergraphs image inpainting. The trained model's performance is assessed by calculating the peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) between network-predicted and ground truth images. The Hypergraphs image inpainting model provided an average SSIM of 0.93 for 2x and up to 0.93 for the final 4x, respectively, and a PSNR of 32.33 for 2x and up to 32.20 for the final 4x. The developed SAM and GAN frameworks can be used in a variety of industrial applications, including bio-imaging.
引用
收藏
页数:12
相关论文
共 51 条
  • [1] PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
    Barnes, Connelly
    Shechtman, Eli
    Finkelstein, Adam
    Goldman, Dan B.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [2] Becker Becker nachrichtentechnik gmbh (bnt), 2022, 1W WID AMPL
  • [3] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [4] Briggs A.O. Kolosov., 2010, ACOUSTIC MICROSCOPY
  • [5] Image Multi-Inpainting via Progressive Generative Adversarial Networks
    Cai, Jiayin
    Li, Changlin
    Tao, Xin
    Tai, Yu-Wing
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 977 - 986
  • [6] Deep Colorization
    Cheng, Zezhou
    Yang, Qingxiong
    Sheng, Bin
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 415 - 423
  • [7] Clevert D.-A., 2015, ARXIV PREPRINT ARXIV
  • [8] Region filling and object removal by exemplar-based image inpainting
    Criminisi, A
    Pérez, P
    Toyama, K
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) : 1200 - 1212
  • [9] Demir U, 2018, Arxiv, DOI arXiv:1803.07422
  • [10] Fragment-based image completion
    Drori, I
    Cohen-Or, D
    Yeshurun, H
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03): : 303 - 312