Bayes R-CNN: An Uncertainty-Aware Bayesian Approach to Object Detection in Remote Sensing Imagery for Enhanced Scene Interpretation

被引:6
作者
Sharifuzzaman, Sagar A. S. M. [1 ]
Tanveer, Jawad [2 ]
Chen, Yu [3 ]
Chan, Jun Hoong [4 ]
Kim, Hyung Seok [1 ]
Kallu, Karam Dad [5 ]
Ahmed, Shahzad [6 ]
机构
[1] Sejong Univ, Dept AI & Robot, Seoul 05006, South Korea
[2] Sejong Univ, Dept Comp Sci & Engn, Seoul 05006, South Korea
[3] Chinese Acad Sci, Ningbo Inst Mat Technol & Engn, Ningbo 315201, Peoples R China
[4] Peking Univ, Sch Comp Sci, Beijing 100871, Peoples R China
[5] Natl Univ Sci & Technol NUST, Sch Mech & Mfg Engn SMME, Dept Robot & Artificial Intelligence R&AI, H-12, Islamabad, Pakistan
[6] Hanyang Univ, Dept Elect Engn, Seoul 04763, South Korea
关键词
remote sensing; Bayesian object detection; FPN; deep learning; attention module;
D O I
10.3390/rs16132405
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Remote sensing technology has been modernized by artificial intelligence, which has made it possible for deep learning algorithms to extract useful information from images. However, overfitting and lack of uncertainty quantification, high-resolution images, information loss in traditional feature extraction, and background information retrieval for detected objects limit the use of deep learning models in various remote sensing applications. This paper proposes a Bayes by backpropagation (BBB)-based system for scene-driven identification and information retrieval in order to overcome the above-mentioned problems. We present the Bayes R-CNN, a two-stage object detection technique to reduce overfitting while also quantifying uncertainty for each object recognized within a given image. To extract features more successfully, we replace the traditional feature extraction model with our novel Multi-Resolution Extraction Network (MRENet) model. We propose the multi-level feature fusion module (MLFFM) in the inner lateral connection and a Bayesian Distributed Lightweight Attention Module (BDLAM) to reduce information loss in the feature pyramid network (FPN). In addition, our system incorporates a Bayesian image super-resolution model which enhances the quality of the image to improve the prediction accuracy of the Bayes R-CNN. Notably, MRENet is used to classify the background of the detected objects to provide detailed interpretation of the object. Our proposed system is comprehensively trained and assessed utilizing the state-of-the-art DIOR and HRSC2016 datasets. The results demonstrate our system's ability to detect and retrieve information from remote sensing scene images.
引用
收藏
页数:31
相关论文
共 61 条
[1]  
Cha K, 2024, Arxiv, DOI [arXiv:2304.05215, DOI 10.1109/JSTARS.2024.3401772]
[2]   Info-FPN: An Informative Feature Pyramid Network for object detection in remote sensing images [J].
Chen, Silin ;
Zhao, Jiaqi ;
Zhou, Yong ;
Wang, Hanzheng ;
Yao, Rui ;
Zhang, Lixu ;
Xue, Yong .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 214
[3]   PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments [J].
Chen, Zhiming ;
Chen, Kean ;
Lin, Weiyao ;
See, John ;
Yu, Hui ;
Ke, Yan ;
Yang, Cong .
COMPUTER VISION - ECCV 2020, PT V, 2020, 12350 :195-211
[4]   Guiding Clean Features for Object Detection in Remote Sensing Images [J].
Cheng, Gong ;
He, Min ;
Hong, Hailong ;
Yao, Xiwen ;
Qian, Xiaoliang ;
Guo, Lei .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[5]  
Dai JF, 2016, ADV NEUR IN, V29
[6]   Learning RoI Transformer for Oriented Object Detection in Aerial Images [J].
Ding, Jian ;
Xue, Nan ;
Long, Yang ;
Xia, Gui-Song ;
Lu, Qikai .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2844-2853
[7]   Attention-Based Multi-Level Feature Fusion for Object Detection in Remote Sensing Images [J].
Dong, Xiaohu ;
Qin, Yao ;
Gao, Yinghui ;
Fu, Ruigang ;
Liu, Songlin ;
Ye, Yuanxin .
REMOTE SENSING, 2022, 14 (15)
[8]   Multiscale Deformable Attention and Multilevel Features Aggregation for Remote Sensing Object Detection [J].
Dong, Xiaohu ;
Qin, Yao ;
Fu, Ruigang ;
Gao, Yinghui ;
Liu, Songlin ;
Ye, Yuanxin ;
Li, Biao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[9]  
Feng P., 2020, P 2020 IEEE INT C AC
[10]   NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection [J].
Ghiasi, Golnaz ;
Lin, Tsung-Yi ;
Le, Quoc V. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7029-7038