AOSVSSNet: Attention-Guided Optical Satellite Video Smoke Segmentation Network

被引:10
作者
Wang, Taoyang [1 ]
Hong, Jianzhi [1 ]
Han, Yuqi [2 ]
Zhang, Guo [3 ]
Chen, Shili [1 ]
Dong, Tiancheng [3 ]
Yang, Yapeng [4 ]
Ruan, Hang [5 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[4] Peoples Liberat Army, Navy Res Inst, Beijing 100036, Peoples R China
[5] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
关键词
Image segmentation; Satellites; Optical imaging; Feature extraction; Optical sensors; Optical reflection; Deep learning; Convolutional neural network; moving object segmentation; satellite video; smoke segmentation; CONVOLUTIONAL NETWORKS; CLASSIFICATION;
D O I
10.1109/JSTARS.2022.3209541
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Smoke is more observable than open fires. Optical satellite video has the advantages of a wide monitoring range, fast response speed, and good economy in large-scale surface smoke monitoring tasks. It can be used in wide-area forest wildfire monitoring, battlefield dynamic monitoring, disaster relief decision-making. The smoke segmentation method based on traditional handcrafted features is easily limited by the scene and data. This article introduces the deep learning method to the optical satellite video smoke target segmentation. However, due to the lack of real smoke images and the blurred edges of smoke, there are currently few labeled datasets for smoke segmentation in high-resolution optical satellite imagery scenes, which cannot provide sufficient training data for deep learning models. The smoke image from the satellite perspective also has the characteristics of multiscale features and ground object background interference. To solve the abovementioned problems, we construct a set of high-resolution optical satellite imagery smoke synthesis datasets based on the optical imaging process of smoke targets, which saves the cost of manual labeling. In addition, we design an attention-guided optical satellite video smoke segmentation network model, which can effectively suppress the ground object background's false alarm and extract the smoke's multiscale features. Synthetic data faces the transferability problem in real-world applications, so the physical constraints of the smoke imaging process are introduced into the loss function to improve the generalization of the model in real smoke data. The comprehensive evaluation results show that the method outperforms representative semantic segmentation networks.
引用
收藏
页码:8552 / 8566
页数:15
相关论文
共 50 条
  • [21] GLIMS: Attention-guided lightweight multi-scale hybrid network for volumetric semantic segmentation
    Yazici, Ziya Ata
    Oksuz, Ilkay
    Ekenel, Hazim Kemal
    IMAGE AND VISION COMPUTING, 2024, 146
  • [22] Dense Dilated Multi-Scale Supervised Attention-Guided Network for histopathology image segmentation
    Das, Rangan
    Bose, Shirsha
    Chowdhury, Ritesh Sur
    Maulik, Ujjwal
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 163
  • [23] DCACNet: Dual context aggregation and attention-guided cross deconvolution network for medical image segmentation
    Lu, Hongchun
    Tian, Shengwei
    Yu, Long
    Liu, Lu
    Cheng, Junlong
    Wu, Weidong
    Kang, Xiaojing
    Zhang, Dezhi
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 214
  • [24] Lightweight attention-guided redundancy-reuse network for real-time semantic segmentation
    Hu, Xuegang
    Xu, Shuhan
    Jing, Liyuan
    IET IMAGE PROCESSING, 2023, 17 (09) : 2649 - 2658
  • [25] Attention-Guided Disentangled Feature Aggregation for Video Object Detection
    Muralidhara, Shishir
    Hashmi, Khurram Azeem
    Pagani, Alain
    Liwicki, Marcus
    Stricker, Didier
    Afzal, Muhammad Zeshan
    SENSORS, 2022, 22 (21)
  • [26] Attention-Guided Instance Segmentation for Group-Raised Pigs
    Hu, Zhiwei
    Yang, Hua
    Yan, Hongwen
    ANIMALS, 2023, 13 (13):
  • [27] Attention-Guided Hybrid Network for Dementia Diagnosis With Structural MR Images
    Lian, Chunfeng
    Liu, Mingxia
    Pan, Yongsheng
    Shen, Dinggang
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 1992 - 2003
  • [28] An Attention-Guided CNN Framework for Segmentation and Grading of Glioma Using 3D MRI Scans
    Tripathi, Prasun Chandra
    Bag, Soumen
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2023, 20 (03) : 1890 - 1904
  • [29] Supervised Multi-Scale Attention-Guided Ship Detection in Optical Remote Sensing Images
    Hu, Jianming
    Zhi, Xiyang
    Jiang, Shikai
    Tang, Hao
    Zhang, Wei
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Attention-Guided Multi-Scale Segmentation Neural Network for Interactive Extraction of Region Objects from High-Resolution Satellite Imagery
    Li, Kun
    Hu, Xiangyun
    Jiang, Huiwei
    Shu, Zhen
    Zhang, Mi
    REMOTE SENSING, 2020, 12 (05)