Implicit neural representations in light microscopy

被引:0
|
作者
Hauser, Sophie Louise [1 ]
Brosig, Johanna [2 ]
Murthy, Bhargavi [3 ]
Attardo, Alessio [3 ]
Kist, Andreas M. [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg FAU, Dept Artificial Intelligence Biomed Engn, Erlangen, Germany
[2] Charite Univ Med Berlin, Berlin, Germany
[3] Leibniz Inst Neurobiol, Leibniz, Germany
来源
BIOMEDICAL OPTICS EXPRESS | 2024年 / 15卷 / 04期
关键词
DENDRITIC SPINES;
D O I
10.1364/BOE.515517
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Three-dimensional stacks acquired with confocal or two-photon microscopy are crucial for studying neuroanatomy. However, high-resolution image stacks acquired at multiple depths are time-consuming and susceptible to photobleaching. In vivo microscopy is further prone to motion artifacts. In this work, we suggest that deep neural networks with sine activation functions encoding implicit neural representations (SIRENs) are suitable for predicting intermediate planes and correcting motion artifacts, addressing the aforementioned shortcomings. We show that we can accurately estimate intermediate planes across multiple micrometers and fully automatically and unsupervised estimate a motion-corrected denoised picture. We show that noise statistics can be affected by SIRENs, however, rescued by a downstream denoising neural network, shown exemplarily with the recovery of dendritic spines. We believe that the application of these technologies will facilitate more efficient acquisition and superior post-processing in the future.
引用
收藏
页码:2175 / 2186
页数:12
相关论文
共 50 条
  • [1] Fourier ptychographic microscopy image stack reconstruction using implicit neural representations
    Zhou, Haowen
    Feng, Brandon Y.
    Guo, Haiyun
    Lin, Siyu
    Liang, Mingshu
    Metzler, Christopher A.
    Yang, Changhuei
    OPTICA, 2023, 10 (12): : 1679 - 1687
  • [2] On Quantizing Implicit Neural Representations
    Gordon, Cameron
    Chng, Shin-Fang
    MacDonald, Lachlan
    Lucey, Simon
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 341 - 350
  • [3] Generalised Implicit Neural Representations
    Grattarola, Daniele
    Vandergheynst, Pierre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Compression with Bayesian Implicit Neural Representations
    Guo, Zongyu
    Flamich, Gergely
    He, Jiajun
    Chen, Zhibo
    Hernandez-Lobato, Jose Miguel
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] WIRE: Wavelet Implicit Neural Representations
    Saragadam, Vishwanath
    LeJeune, Daniel
    Tan, Jasper
    Balakrishnan, Guha
    Veeraraghavan, Ashok
    Baraniuk, Richard G.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18507 - 18516
  • [6] Implicit Neural Representations for Image Compression
    Strumpler, Yannick
    Postels, Janis
    Yang, Ren
    Van Gool, Luc
    Tombari, Federico
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 74 - 91
  • [7] Signal Processing for Implicit Neural Representations
    Xu, Dejia
    Wang, Peihao
    Jiang, Yifan
    Fan, Zhiwen
    Wang, Zhangyang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [8] Implicit Neural Representations with Levels-of-Experts
    Hao, Zekun
    Mallya, Arun
    Belongie, Serge
    Liu, Ming-Yu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [9] Hypernetworks Build Implicit Neural Representations of Sounds
    Szatkowski, Filip
    Piczak, Karol J.
    Spurek, Przemyslaw
    Tabor, Jacek
    Trzcinski, Tomasz
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT IV, 2023, 14172 : 661 - 676
  • [10] Implicit Neural Representations for Medical Imaging Segmentation
    Khan, Muhammad Osama
    Fang, Yi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT V, 2022, 13435 : 433 - 443