AOSVSSNet: Attention-Guided Optical Satellite Video Smoke Segmentation Network

被引:10
|
作者
Wang, Taoyang [1 ]
Hong, Jianzhi [1 ]
Han, Yuqi [2 ]
Zhang, Guo [3 ]
Chen, Shili [1 ]
Dong, Tiancheng [3 ]
Yang, Yapeng [4 ]
Ruan, Hang [5 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[4] Peoples Liberat Army, Navy Res Inst, Beijing 100036, Peoples R China
[5] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
关键词
Image segmentation; Satellites; Optical imaging; Feature extraction; Optical sensors; Optical reflection; Deep learning; Convolutional neural network; moving object segmentation; satellite video; smoke segmentation; CONVOLUTIONAL NETWORKS; CLASSIFICATION;
D O I
10.1109/JSTARS.2022.3209541
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Smoke is more observable than open fires. Optical satellite video has the advantages of a wide monitoring range, fast response speed, and good economy in large-scale surface smoke monitoring tasks. It can be used in wide-area forest wildfire monitoring, battlefield dynamic monitoring, disaster relief decision-making. The smoke segmentation method based on traditional handcrafted features is easily limited by the scene and data. This article introduces the deep learning method to the optical satellite video smoke target segmentation. However, due to the lack of real smoke images and the blurred edges of smoke, there are currently few labeled datasets for smoke segmentation in high-resolution optical satellite imagery scenes, which cannot provide sufficient training data for deep learning models. The smoke image from the satellite perspective also has the characteristics of multiscale features and ground object background interference. To solve the abovementioned problems, we construct a set of high-resolution optical satellite imagery smoke synthesis datasets based on the optical imaging process of smoke targets, which saves the cost of manual labeling. In addition, we design an attention-guided optical satellite video smoke segmentation network model, which can effectively suppress the ground object background's false alarm and extract the smoke's multiscale features. Synthetic data faces the transferability problem in real-world applications, so the physical constraints of the smoke imaging process are introduced into the loss function to improve the generalization of the model in real smoke data. The comprehensive evaluation results show that the method outperforms representative semantic segmentation networks.
引用
收藏
页码:8552 / 8566
页数:15
相关论文
共 50 条
  • [41] Attention-guided cascaded network with pixel-importance-balance loss for retinal vessel segmentation
    Su, Hexing
    Gao, Le
    Lu, Yichao
    Jing, Han
    Hong, Jin
    Huang, Li
    Chen, Zequn
    FRONTIERS IN CELL AND DEVELOPMENTAL BIOLOGY, 2023, 11
  • [42] Attention-Guided Disentangled Feature Aggregation for Video Object Detection
    Muralidhara, Shishir
    Hashmi, Khurram Azeem
    Pagani, Alain
    Liwicki, Marcus
    Stricker, Didier
    Afzal, Muhammad Zeshan
    SENSORS, 2022, 22 (21)
  • [43] Attention-Guided Label Refinement Network for Semantic Segmentation of Very High Resolution Aerial Orthoimages
    Huang, Jianfeng
    Zhang, Xinchang
    Sun, Ying
    Xin, Qinchuan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 4490 - 4503
  • [44] DIFA-GAN: Differential Attention-Guided Generative Adversarial Network for Unsupervised Video Forecasting
    Jin, Beibei
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1795 - 1799
  • [45] Attention-Guided Instance Segmentation for Group-Raised Pigs
    Hu, Zhiwei
    Yang, Hua
    Yan, Hongwen
    ANIMALS, 2023, 13 (13):
  • [46] Attention-guided and resource-saving modules for semantic segmentation
    Yu, Beike
    Wang, Dafang
    Cao, Jiang
    Liu, Lei
    Wang, Tao
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [47] Lightweight multi-scale attention-guided network for real-time semantic segmentation
    Hu, Xuegang
    Liu, Yuanjing
    IMAGE AND VISION COMPUTING, 2023, 139
  • [48] SiamAGN: Siamese attention-guided network for visual tracking
    Wei, Bingbing
    Chen, Hongyu
    Ding, Qinghai
    Luo, Haibo
    NEUROCOMPUTING, 2022, 512 : 69 - 82
  • [49] Attention-guided residual frame learning for video anomaly detection
    Yu, Jun-Hyung
    Moon, Jeong-Hyeon
    Sohn, Kyung-Ah
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (08) : 12099 - 12116
  • [50] Gated Spatio-Temporal Attention-Guided Video Deblurring
    Suin, Maitreya
    Rajagopalan, A. N.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7798 - 7807