AOSVSSNet: Attention-Guided Optical Satellite Video Smoke Segmentation Network

被引:10
|
作者
Wang, Taoyang [1 ]
Hong, Jianzhi [1 ]
Han, Yuqi [2 ]
Zhang, Guo [3 ]
Chen, Shili [1 ]
Dong, Tiancheng [3 ]
Yang, Yapeng [4 ]
Ruan, Hang [5 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[4] Peoples Liberat Army, Navy Res Inst, Beijing 100036, Peoples R China
[5] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
关键词
Image segmentation; Satellites; Optical imaging; Feature extraction; Optical sensors; Optical reflection; Deep learning; Convolutional neural network; moving object segmentation; satellite video; smoke segmentation; CONVOLUTIONAL NETWORKS; CLASSIFICATION;
D O I
10.1109/JSTARS.2022.3209541
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Smoke is more observable than open fires. Optical satellite video has the advantages of a wide monitoring range, fast response speed, and good economy in large-scale surface smoke monitoring tasks. It can be used in wide-area forest wildfire monitoring, battlefield dynamic monitoring, disaster relief decision-making. The smoke segmentation method based on traditional handcrafted features is easily limited by the scene and data. This article introduces the deep learning method to the optical satellite video smoke target segmentation. However, due to the lack of real smoke images and the blurred edges of smoke, there are currently few labeled datasets for smoke segmentation in high-resolution optical satellite imagery scenes, which cannot provide sufficient training data for deep learning models. The smoke image from the satellite perspective also has the characteristics of multiscale features and ground object background interference. To solve the abovementioned problems, we construct a set of high-resolution optical satellite imagery smoke synthesis datasets based on the optical imaging process of smoke targets, which saves the cost of manual labeling. In addition, we design an attention-guided optical satellite video smoke segmentation network model, which can effectively suppress the ground object background's false alarm and extract the smoke's multiscale features. Synthetic data faces the transferability problem in real-world applications, so the physical constraints of the smoke imaging process are introduced into the loss function to improve the generalization of the model in real smoke data. The comprehensive evaluation results show that the method outperforms representative semantic segmentation networks.
引用
收藏
页码:8552 / 8566
页数:15
相关论文
共 50 条
  • [1] Attention-Guided Network for Semantic Video Segmentation
    Li, Jiangyun
    Zhao, Yikai
    Fu, Jun
    Wu, Jiajia
    Liu, Jing
    IEEE ACCESS, 2019, 7 : 140680 - 140689
  • [2] Attention-guided Unified Network for Panoptic Segmentation
    Li, Yanwei
    Chen, Xinze
    Zhu, Zheng
    Xie, Lingxi
    Huang, Guan
    Du, Dalong
    Wang, Xingang
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7019 - 7028
  • [3] Multiscale Attention-Guided Panoptic Segmentation Network
    Fu, Du
    Qu, Shaojun
    Fu, Ya
    Computer Engineering and Applications, 2023, 59 (22) : 223 - 232
  • [4] Attention-Guided Memory Model for Video Object Segmentation
    Lin, Yunjian
    Tan, Yihua
    Communications in Computer and Information Science, 2022, 1566 CCIS : 67 - 85
  • [5] Attention-guided Adversarial Attack for Video Object Segmentation
    Yao, Rui
    Chen, Ying
    Zhou, Yong
    Hu, Fuyuan
    Zhao, Jiaqi
    Liu, Bing
    Shao, Zhiwen
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (06)
  • [6] An attention-guided network for bilateral ventricular segmentation in pediatric echocardiography
    Pang J.
    Wang Y.
    Chen L.
    Zhang J.
    Liu J.
    Pei G.
    Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2023, 40 (05): : 928 - 937
  • [7] An attention-guided network for surgical instrument segmentation from endoscopic images
    Yang, Lei
    Gu, Yuge
    Bian, Guibin
    Liu, Yanhong
    Computers in Biology and Medicine, 2022, 151
  • [8] DAFNet: A dual attention-guided fuzzy network for cardiac MRI segmentation
    Luo, Yuxin
    Fang, Yu
    Zeng, Guofei
    Lv, Yibin
    Du, Li
    Nie, Lisha
    Wu, Pu-Yeh
    Zhang, Dechuan
    Fan, Longling
    AIMS MATHEMATICS, 2024, 9 (04): : 8814 - 8833
  • [9] An attention-guided network for surgical instrument segmentation from endoscopic images
    Yang, Lei
    Gu, Yuge
    Bian, Guibin
    Liu, Yanhong
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 151
  • [10] Attention-Guided Pyramid Context Network for Polyp Segmentation in Colonoscopy Images
    Yue, Guanghui
    Li, Siying
    Cong, Runmin
    Zhou, Tianwei
    Lei, Baiying
    Wang, Tianfu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72