Development status and future prospects of multi-source remote sensing image fusion

被引：0
|
作者：
Li S. [1 ]
Li C. [1 ]
Kang X. [1 ]
机构：
[1] School of Electrical and Information Engineering, Hunan University, Changsha
来源：
National Remote Sensing Bulletin | 2021年 / 25卷 / 01期
基金：
中国国家自然科学基金;
关键词：
Ground observation; Image fusion; Multi-modal; Remote sensing image;
D O I：
10.11834/jrs.20210259
中图分类号：
学科分类号：
摘要：
The development of multispectral, hyperspectral, infrared, radar, and other sensing technologies in recent years has facilitated the use of remote sensing methods in precision agriculture, resource investigation, environmental monitoring, military defense, and other fields. Multi-source remote sensing images in the same scene can capture the same ground objects, while the dimensions of the observations are independent of each other. Therefore, the imaging scale, spatial resolution, time resolution, and target characteristics may be quite different in different observations. The information provided by massive multi-source remote sensing data is redundant, complementary, and cooperative. Multi-source remote sensing image fusion can utilize the complementary information obtained from different sources to achieve accurate and comprehensive Earth observations. Thus, it is one of the key technologies in remote sensing. From the perspective of data sources, this review summarizes the research status and future development trends of multi-source remote sensing image fusion. In the introduction, the importance of multi-source image fusion and the motivation of this review are illustrated briefly. The second section outlines the main sources and image characteristics of nine typical remote sensing data: panchromatic images, multispectral images, hyperspectral images, infrared images, nighttime light images, stereo images, video images, Synthetic Aperture Radar (SAR) images, and light detection and ranging (LiDAR) images. The typical applications of these multi-source data are also briefly concluded while introducing the characteristics of these multi-source remote sensing images separately. Moreover, the development trend of multi-source remote sensing image fusion is evaluated according to the number of publications. In the third section, latest studies on multi-source remote sensing image fusion are introduced in detail in the order of optical image fusion, optical and SAR image fusion, optical and LiDAR image fusion, and other types of remote sensing image fusion. The third section also puts forward some challenging problems in remote sensing image fusion. For example, the registration problem of multi-source images, the application problem of fusion in specific domain, and the representation of features during cross-modal fusion are all important problems that need to be solved urgently. In the conclusion section, this review summarizes the research status of the multi-source remote sensing image fusion field. This also section prospects the future development trend of multi-source remote sensing image fusion. First, the study of related fusion technologies for new types of remote sensing images will be a major future research. Second, the integration of data acquisition and image fusion techniques can reduce the difficulty and improve the performance of image fusion with the help of novel hardware designs. Therefore, multi-modal fusion-based computational imaging systems should be designed. Third, fusing multi-source images with other types of data, such as geographical, ground station, and web data, is an interesting research topic in addition to the fusion of remote sensing images. Finally, evaluating the performance of image fusion is an important problem. Image fusion aims to help better understand the land covers from different dimensions of Earth observations. Whether the fusion can help the understanding of the Earth is unclear. Therefore, the improvement in application performance, such as detection or classification accuracy, may be an important index compared with the enhancement in the quality of the fused image. © 2021, Science Press. All right reserved.
引用
收藏
页码：148 / 166
页数：18
相关论文
共 131 条
  • [11] Chaturvedi S K, Banerjee S, Lele S., An assessment of oil spill detection using Sentinel 1 SAR-C images, Journal of Ocean Engineering and Science, 5, 2, pp. 116-135, (2020)
  • [12] Chaussard E, Wdowinski S, Cabral-Cano E, Amelung F., Land subsidence in central Mexico detected by ALOS InSAR time-series, Remote Sensing of Environment, 140, pp. 94-106, (2014)
  • [13] Chen B, Huang B, Xu B., Multi-source remotely sensed data fusion for improving land cover classification, ISPRS Journal of Photogrammetry and Remote Sensing, 124, pp. 27-39, (2017)
  • [14] Chen S H, Zhang R H, Su H B, Tian J, Xia J., SAR and multispectral image fusion using generalized IHS transform based on à trous wavelet and EMD decompositions, IEEE Sensors Journal, 10, 3, pp. 737-745, (2010)
  • [15] Chen Y B, Zheng Z H, Wu Z F, Qian Q L., Review and prospect of application of nighttime light remote sensing data, Progress in Geography, 38, 2, pp. 205-223, (2019)
  • [16] Chen Z, Pu H Y, Wang B, Jiang G M., Fusion of hyperspectral and multispectral images: a novel framework based on generalization of pan-sharpening methods, IEEE Geoscience and Remote Sensing Letters, 11, 8, pp. 1418-1422, (2014)
  • [17] Cui M H, Zhou J J, Chen C., The physical principle of synthetic aperture radar and its military application, Technology Foundation of National Defence, 4, pp. 4-5, (2004)
  • [18] Dian R W, Li S T, Fang L Y., Learning a low tensor-train rank representation for hyperspectral image super-resolution, IEEE Transactions on Neural Networks and Learning Systems, 30, 9, pp. 2672-2683, (2019)
  • [19] Dong C, Loy C C, He K M, Tang X O., Image super-resolution using deep convolutional networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2, pp. 295-307, (2016)
  • [20] Du W H, Qin Z H, Li Y., Advances in thermal infrared remote sensing and its application in agricultural drought monitoring, China Agricultural Informatics, 30, 2, pp. 24-41, (2018)
12345678910