Multispectral Image Super-Resolution Using Structure-Guided RGB Image Fusion

被引:1
作者
Pan, Zhi-Wei [1 ]
Shen, Hui-Liang [1 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT I | 2018年 / 11256卷
基金
中国国家自然科学基金;
关键词
Multispectral imaging; Super-resolution; Directional total variation; Image reconstruction; Image fusion;
D O I
10.1007/978-3-030-03398-9_14
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to hardware limitation, multispectral imaging device usually cannot achieve high spatial resolution. To address the issue, this paper proposes a multispectral image super-resolution algorithm by fusing the low-resolution multispectral image and the high-resolution RGB image. The fusion is formulated as an optimization problem according to the linear image degradation models. Meanwhile, the fusion is guided by the edge structure of RGB image via the directional total variation regularizer. Then the fusion problem is solved by the alternating direction method of multipliers algorithm through iteration. The subproblems in each iterative step is simple and can be solved in closed-form. The effectiveness of the proposed algorithm is evaluated on both public datasets and our image set. Experimental results validate that the algorithm outperforms the state-of-the-arts in terms of both reconstruction accuracy and computational efficiency.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 20 条
[1]  
Berns RoyS., 2005, P NATL ACAD SCI SACK, V12, P105
[2]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[3]  
Chakrabarti A, 2011, PROC CVPR IEEE, P193, DOI 10.1109/CVPR.2011.5995660
[4]   Normalized Total Gradient: A New Measure for Multispectral Image Registration [J].
Chen, Shu-Jie ;
Shen, Hui-Liang ;
Li, Chunguang ;
Xin, John H. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (03) :1297-1310
[5]   Hyperspectral image super-resolution via non-local sparse tensor factorization [J].
Dian, Renwei ;
Fang, Leyuan ;
Li, Shutao .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3862-3871
[6]   Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation [J].
Dong, Weisheng ;
Fu, Fazuo ;
Shi, Guangming ;
Cao, Xun ;
Wu, Jinjian ;
Li, Guangyu ;
Li, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (05) :2337-2352
[7]   Multicontrast MRI Reconstruction with Structure-Guided Total Variation [J].
Ehrhardt, Matthias J. ;
Betcke, Marta M. .
SIAM JOURNAL ON IMAGING SCIENCES, 2016, 9 (03) :1084-1106
[8]   A New Pan-Sharpening Method With Deep Neural Networks [J].
Huang, Wei ;
Xiao, Liang ;
Wei, Zhihui ;
Liu, Hongyi ;
Tang, Songze .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (05) :1037-1041
[9]  
Jiang J, 2013, IEEE WORK APP COMP, P168, DOI 10.1109/WACV.2013.6475015
[10]   Radiometric Calibration by Rank Minimization [J].
Lee, Joon-Young ;
Matsushita, Yasuyuki ;
Shi, Boxin ;
Kweon, In So ;
Ikeuchi, Katsushi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :144-156