DIFFUSION MODELS FOR REMOTE SENSING IMAGERY SEMANTIC SEGMENTATION

被引:11
作者
Ayala, C. [1 ]
Sesma, R. [1 ]
Aranda, C. [1 ]
Galar, M. [2 ]
机构
[1] Tracasa Instrumental, Calle Cabarceno 6, Navarra 31621, Spain
[2] Univ Publ Navarra, Inst Smart Cities ISC, Arrosadia Campus, Pamplona 31006, Spain
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
关键词
Denoising Diffusion Probabilistic Models; Semantic Segmentation; Remote Sensing; Building Segmentation; Uncertainty Estimation;
D O I
10.1109/IGARSS52108.2023.10281461
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Denoising Diffusion Probabilistic Models have exhibited impressive performance for generative modelling of images. This paper aims to explore the potential of diffusion models for semantic segmentation tasks in the context of remote sensing. The major challenge of employing these models for semantic segmentation tasks is the generative nature of the model, which produces an arbitrary segmentation mask from a random noise input. Therefore, the diffusion process needs to be constrained to produce a segmentation mask that matches the target image. To address this issue, the denoising process is conditioned by utilizing the input image as a reference. In the experimental study, the proposed model is compared against other state-of-the-art semantic segmentation architectures using the Massachusetts Buildings Aerial dataset. The results of this study provide valuable insights into the potential of diffusion models for semantic segmentation tasks in the field of remote sensing.
引用
收藏
页码:5654 / 5657
页数:4
相关论文
共 14 条
[1]  
Amit T., 2022, Segdiff: Image segmentation with diffusion probabilistic models
[2]  
[Anonymous], 2021, CVPR, DOI DOI 10.1109/CVPR46437.2021.01001
[3]  
Baranchuk Dmitry., 2022, Label-efficient semantic segmentation with diffusion models
[4]   Diffusion Models in Vision: A Survey [J].
Croitoru, Florinel-Alin ;
Hondru, Vlad ;
Ionescu, Radu Tudor ;
Shah, Mubarak .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) :10850-10869
[5]  
Ho Jonathan., 2020, P 34 INT C NEURAL IN, P6840
[6]  
Melas-Kyriazi Luke, 2021, FINDING UNSUPERVISED
[7]  
Mnih Volodymyr., 2013, Machine learning for aerial image labeling
[8]  
Nichol A. Q., 2021, Improved Denoising Diffusion Probabilistic Models
[9]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[10]  
Sohl-Dickstein Jascha., 2015, Deep unsupervised learning using nonequilibrium thermodynamics