Generative Models for Inverse Imaging Problems: From mathematical foundations to physics-driven applications

被引:12
作者
Zhao, Zhizhen [1 ,2 ]
Ye, Jong Chul [3 ]
Bresler, Yoram [2 ,4 ]
机构
[1] Univ Illinois Urbana Champaign UIUC, William L Everitt Fac Fellow, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Univ Illinois Urbana Champaign UIUC, Coordinated Sci Lab, Urbana, IL 61801 USA
[3] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejon, South Korea
[4] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Inverse problems; Computational modeling; Imaging; Generative adversarial networks; Mathematical models; Physics; CRYO-EM; RECONSTRUCTION; CYCLEGAN;
D O I
10.1109/MSP.2022.3215282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Physics-informed generative modeling for inverse problems in computational imaging is a fast-growing field encompassing a variety of methods and applications. Here, we review a few generative modeling techniques, such as variational autoencoders (VAEs) and generative adversarial networks (GANs), as well as more recent developments in score-based generative models. Through different imaging applications, we review how the generative modeling techniques are effectively combined with the physics of the imaging problem, e.g., the measurement forward model and physical properties of the target objects, to solve the inverse problems.
引用
收藏
页码:148 / 163
页数:16
相关论文
共 58 条
[1]  
Akçakaya M, 2022, IEEE SIGNAL PROC MAG, V39, P28, DOI [10.1109/MSP.2021.3119273, 10.1109/msp.2021.3119273]
[2]  
Anderson Brian DO, 1982, Stochastic Processes and their Applications, V12, P313, DOI DOI 10.1016/0304-4149(82)90051-5
[3]  
[Anonymous], 2019, ADV NEUR IN
[4]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[5]   Blind Image Deconvolution Using Deep Generative Priors [J].
Asim, Muhammad ;
Shamshad, Fahad ;
Ahmed, Ali .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 :1493-1506
[6]   Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models [J].
Bond-Taylor, Sam ;
Leach, Adam ;
Long, Yang ;
Willcocks, Chris G. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) :7327-7347
[7]  
Bora A, 2017, PR MACH LEARN RES, V70
[8]  
Burda Y., 2016, PROC INT C LEARN REP
[9]  
Chen Ricky T. Q., 2018, Advances in Neural Information Processing Systems, V31
[10]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807