Super-resolution biomedical imaging via reference-free statistical implicit neural representation

被引:3
作者
Ye, Siqi [1 ]
Shen, Liyue [2 ]
Islam, Md Tauhidul [1 ]
Xing, Lei [1 ]
机构
[1] Stanford Univ, Dept Radiat Oncol, Stanford, CA 94305 USA
[2] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
基金
美国国家卫生研究院;
关键词
unsupervised learning; implicit neural representation; maximum likelihood estimation; biomedical imaging; super-resolution; multi-scale imaging; inverse problem; HIGH-RESOLUTION IMAGE; MULTIFRAME SUPERRESOLUTION; RECONSTRUCTION; REGISTRATION; RESTORATION; NOISY;
D O I
10.1088/1361-6560/acfdf1
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Supervised deep learning for image super-resolution (SR) has limitations in biomedical imaging due to the lack of large amounts of low- and high-resolution image pairs for model training. In this work, we propose a reference-free statistical implicit neural representation (INR) framework, which needs only a single or a few observed low-resolution (LR) image(s), to generate high-quality SR images. Approach. The framework models the statistics of the observed LR images via maximum likelihood estimation and trains the INR network to represent the latent high-resolution (HR) image as a continuous function in the spatial domain. The INR network is constructed as a coordinate-based multi-layer perceptron, whose inputs are image spatial coordinates and outputs are corresponding pixel intensities. The trained INR not only constrains functional smoothness but also allows an arbitrary scale in SR imaging. Main results. We demonstrate the efficacy of the proposed framework on various biomedical images, including computed tomography (CT), magnetic resonance imaging (MRI), fluorescence microscopy, and ultrasound images, across different SR magnification scales of 2x, 4x, and 8x. A limited number of LR images were used for each of the SR imaging tasks to show the potential of the proposed statistical INR framework. Significance. The proposed method provides an urgently needed unsupervised deep learning framework for numerous biomedical SR applications that lack HR reference images.
引用
收藏
页数:16
相关论文
共 59 条
[1]  
Anger J., 2020, ISPRS Ann. Photogramm., Remote Sens. Spatial Inf. Sci, P57, DOI [10.5194/isprs-annals-V-1-2020-57-2020, DOI 10.5194/ISPRS-ANNALS-V-1-2020-57-2020]
[2]   Computed tomography reconstruction using deep image prior and learned reconstruction methods [J].
Baguer, Daniel Otero ;
Leuschner, Johannes ;
Schmidt, Maximilian .
INVERSE PROBLEMS, 2020, 36 (09)
[3]  
Basri R, 2020, PR MACH LEARN RES, V119
[4]  
Bell-Kligler S, 2019, ADV NEUR IN, V32
[5]   Super-resolution from image sequences - A review [J].
Borman, S ;
Stevenson, RL .
1998 MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, PROCEEDINGS, 1999, :374-378
[6]  
Bose N. K., 1993, ICASSP-93. 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing (Cat. No.92CH3252-4), P269, DOI 10.1109/ICASSP.1993.319799
[7]   Optimization of Image B-spline Interpolation for GPU Architectures [J].
Briand, Thibaud ;
Davy, Axel .
IMAGE PROCESSING ON LINE, 2019, 9 :183-204
[8]   Theory and Practice of Image B-Spline Interpolation [J].
Briand, Thibaud ;
Monasse, Pascal .
IMAGE PROCESSING ON LINE, 2018, 8 :99-141
[9]   To Learn Image Super-Resolution, Use a GAN to Learn How to Do Image Degradation First [J].
Bulat, Adrian ;
Yang, Jing ;
Tzimiropoulos, Georgios .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :187-202
[10]   Real-world single image super-resolution: A brief review [J].
Chen, Honggang ;
He, Xiaohai ;
Qing, Linbo ;
Wu, Yuanyuan ;
Ren, Chao ;
Sheriff, Ray E. ;
Zhu, Ce .
INFORMATION FUSION, 2022, 79 :124-145