Domain-Knowledge-Guided Multisource Fusion Network for Small Water Bodies Mapping Using PlanetScope Multispectral and Google Earth RGB Images

被引:0
|
作者
Zhou, Pu [1 ,2 ]
Li, Xiaodong [1 ]
Zhang, Yihang [1 ]
Wang, Yalan [1 ,2 ]
Li, Yuyang [1 ,2 ]
Li, Xiang [1 ,2 ]
Zhou, Chi [3 ]
Shen, Laiyin [3 ]
Du, Yun [1 ]
机构
[1] Chinese Acad Sci, Innovat Acad Precis Measurement Sci & Technol, Key Lab Environm & Disaster Monitoring & Evaluat H, Wuhan 430077, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Hubei Water Resources Res Inst, Hubei Water Resources & Hydropower Sci & Technol P, Wuhan 430070, Peoples R China
关键词
Deep learning; Spatial resolution; Sensors; Indexes; Image segmentation; Water resources; Land surface; Image sensors; Feature extraction; Accuracy; domain knowledge; image fusion; sample reweighting; small water body (SWB); CLASS IMBALANCE; RESOLUTION;
D O I
10.1109/JSTARS.2024.3509712
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mapping of small water bodies (SWBs) has been facilitated by very high resolution remote sensing images. The multispectral PlanetScope image, with visible to near-infrared bands at 3-m resolution, has been continuously used for mapping SWBs recently, but accurately delineating SWB boundaries remains challenging. The Google Earth image allows for mapping surface water at a finer resolution than PlanetScope, but it lacks the near-infrared band in which water and nonwater are usually distinctive. This article proposes a novel domain-knowledge-guided multisource fusion network (DKFNet), which fuses PlanetScope with Google Earth images to map SWBs at 1-m resolution while integrating the complementary information from each data. DKFNet utilizes the normalized difference water index (NDWI) image from PlanetScope image as domain knowledge for water mapping. DKFNet contains a domain-knowledge-based coordinate attention module, which has an advantage in detecting small objects, to incorporate the position and distribution information of SWBs from the NDWI image. DKFNet incorporates a domain-knowledge-based atrous spatial pyramid pooling module that extracts the multiscale features of water bodies from the NDWI image. Finally, DKFNet employs a novel reweighting loss to adjust the sample weights, enabling the network to focus on SWBs and water-nonwater boundaries, which are difficult to map accurately from traditional deep-learning networks. Results demonstrate that DKFNet predicted better water boundaries and reduced many false positives predicted by deep-learning networks using PlanetScope-only image and Google Earth-only image. DKFNet also can better map SWBs than several state-of-the-art networks using both PlanetScope and Google Earth images.
引用
收藏
页码:2541 / 2562
页数:22
相关论文
共 2 条
  • [1] Deep Feature and Domain Knowledge Fusion Network for Mapping Surface Water Bodies by Fusing Google Earth RGB and Sentinel-2 Images
    Zhou, Pu
    Li, Xiaodong
    Foody, Giles M.
    Boyd, Doreen S.
    Wang, Xia
    Ling, Feng
    Zhang, Yihang
    Wang, Yalan
    Du, Yun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [2] Deep Feature and Domain Knowledge Fusion Network for Mapping Surface Water Bodies by Fusing Google Earth RGB and Sentinel-2 Images
    Zhou, Pu
    Li, Xiaodong
    Foody, Giles M.
    Boyd, Doreen S.
    Wang, Xia
    Ling, Feng
    Zhang, Yihang
    Wang, Yalan
    Du, Yun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20