Equivariant Imaging: Learning Beyond the Range Space

被引:50
作者
Chen, Dongdong [1 ]
Tachella, Julian [1 ]
Davies, Mike E. [1 ]
机构
[1] Univ Edinburgh, Sch Engn, Edinburgh, Midlothian, Scotland
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
INVERSE PROBLEMS; NETWORK;
D O I
10.1109/ICCV48922.2021.00434
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In various imaging problems, we only have access to compressed measurements of the underlying signals, hindering most learning-based strategies which usually require pairs of signals and associated measurements for training. Learning only from compressed measurements is impossible in general, as the compressed observations do not contain information outside the range of the forward sensing operator. We propose a new end-to-end self-supervised framework that overcomes this limitation by exploiting the equivariances present in natural signals. Our proposed learning strategy performs as well as fully supervised methods. Experiments demonstrate the potential of this framework on inverse problems including sparse-view X-ray computed tomography on real clinical data and image inpainting on natural images.
引用
收藏
页码:4359 / 4368
页数:10
相关论文
共 40 条
[1]  
Batson J, 2019, PR MACH LEARN RES, V97
[2]  
Belthangady Chinmay, 2019, NATURE METHODS, V16
[3]  
Bora A., 2018, INT C LEARN REPR
[4]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[5]  
Chen D.Z., 2020, P EUR C COMP VIS ECC
[6]  
Chen D, 2020, USNC-URSI RADIO SCI, P23, DOI [10.23919/USNC/URSI49741.2020.9321669, 10.23919/usnc/ursi49741.2020.9321669]
[7]   The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository [J].
Clark, Kenneth ;
Vendt, Bruce ;
Smith, Kirk ;
Freymann, John ;
Kirby, Justin ;
Koppel, Paul ;
Moore, Stephen ;
Phillips, Stanley ;
Maffitt, David ;
Pringle, Michael ;
Tarbox, Lawrence ;
Prior, Fred .
JOURNAL OF DIGITAL IMAGING, 2013, 26 (06) :1045-1057
[8]   An iterative thresholding algorithm for linear inverse problems with a sparsity constraint [J].
Daubechies, I ;
Defrise, M ;
De Mol, C .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2004, 57 (11) :1413-1457
[9]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[10]  
Foster Adam, 2020, ARXIV201009515