Boosting One-Shot Spectral Super-Resolution Using Transfer Learning

被引:14
作者
Wei, Wei [1 ,2 ,3 ]
Sun, Yuxuan [2 ,3 ]
Zhang, Lei [2 ,3 ]
Nie, Jiangtao [2 ,3 ]
Zhang, Yanning [2 ,3 ]
机构
[1] Northwestern Polytech Univ Shenzhen, Res & Dev Inst, Shenzhen 518031, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerospace Ground Ocean B, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Hyperspectral imagery; spectral super-resolution; deep neural network; transfer learning; one-shot learning; ALGORITHMS;
D O I
10.1109/TCI.2020.3031070
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Though deep learning based spectral super-resolution (SSR) methods have state-of-the-art performances, most previous deep spectral super-resolution approaches require extensive paired RGB images and hyperspectral images (HSIs) for well-fitting learning. However, in real cases, the cost of generating such paired images is too prohibitive to collect sufficient training samples. To solve this problem, we investigated one-shot SSR in a target domain. To avoid over-fitting, we introduced knowledge from a source domain to guide the one-shot SSR in the target domain and use the idea of spectral unmixing to remove the interference of different spectral characteristics, with which we proposed a spectral-unmixing inspired deep SSR framework. Experimental results on three benchmark SSR datasets showed the effectiveness of the proposed method.
引用
收藏
页码:1459 / 1470
页数:12
相关论文
共 26 条
[1]   Adversarial Networks for Spatial Context-Aware Spectral Image Reconstruction from RGB [J].
Alvarez-Gila, Aitor ;
van de Weijer, Joost ;
Garrote, Estibaliz .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :480-490
[2]   Filter Selection for Hyperspectral Estimation [J].
Arad, Boaz ;
Ben-Shahar, Ohad .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3172-3180
[3]   Sparse Recovery of Hyperspectral Signal from Natural RGB Images [J].
Arad, Boaz ;
Ben-Shahar, Ohad .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :19-34
[4]  
Chakrabarti A, 2011, PROC CVPR IEEE, P193, DOI 10.1109/CVPR.2011.5995660
[5]  
Clark R. N., 1995, LUNAR PLANETARY SCI, VXXVI, P255
[6]   Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation [J].
Dong, Weisheng ;
Fu, Fazuo ;
Shi, Guangming ;
Cao, Xun ;
Wu, Jinjian ;
Li, Guangyu ;
Li, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (05) :2337-2352
[7]   Application of Hyperspectral Imaging in Food Safety Inspection and Control: A Review [J].
Feng, Yao-Ze ;
Sun, Da-Wen .
CRITICAL REVIEWS IN FOOD SCIENCE AND NUTRITION, 2012, 52 (11) :1039-1058
[8]   Joint Camera Spectral Sensitivity Selection and Hyperspectral Image Recovery [J].
Fu, Ying ;
Zhang, Tao ;
Zheng, Yinqiang ;
Zhang, Debing ;
Huang, Hua .
COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 :812-828
[9]   Hyperspectral vegetation indices and novel algorithms for predicting green LAI of crop canopies: Modeling and validation in the context of precision agriculture [J].
Haboudane, D ;
Miller, JR ;
Pattey, E ;
Zarco-Tejada, PJ ;
Strachan, IB .
REMOTE SENSING OF ENVIRONMENT, 2004, 90 (03) :337-352
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778