Integration of Object-Based Image Analysis and Convolutional Neural Network for the Classification of High-Resolution Satellite Image: A Comparative Assessment

被引:8
作者
Azeez, Omer Saud [1 ]
Shafri, Helmi Z. M. [1 ,2 ]
Alias, Aidi Hizami [1 ]
Haron, Nuzul A. B. [1 ]
机构
[1] Univ Putra Malaysia UPM, Fac Engn, Dept Civil Engn, Serdang 43400, Selangor, Malaysia
[2] Univ Putra Malaysia UPM, Fac Engn, Geospatial Informat Sci Res Ctr GISRC, Serdang 43400, Selangor, Malaysia
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 21期
关键词
deep learning; convolutional neural networks; Object-Based Image Analysis; remote sensing; integration frameworks;
D O I
10.3390/app122110890
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
During the past decade, deep learning-based classification methods (e.g., convolutional neural networks-CNN) have demonstrated great success in a variety of vision tasks, including satellite image classification. Deep learning methods, on the other hand, do not preserve the precise edges of the targets of interest and do not extract geometric features such as shape and area. Previous research has attempted to address such issues by combining deep learning with methods such as object-based image analysis (OBIA). Nonetheless, the question of how to integrate those methods into a single framework in such a way that the benefits of each method complement each other remains. To that end, this study compared four integration frameworks in terms of accuracy, namely OBIA artificial neural network (OBIA ANN), feature fusion, decision fusion, and patch filtering, according to the results. Patch filtering achieved 0.917 OA, whereas decision fusion and feature fusion achieved 0.862 OA and 0.860 OA, respectively. The integration of CNN and OBIA can improve classification accuracy; however, the integration framework plays a significant role in this. Future research should focus on optimizing the existing CNN and OBIA frameworks in terms of architecture, as well as investigate how CNN models should use OBIA outputs for feature extraction and classification of remotely sensed images.
引用
收藏
页数:21
相关论文
共 36 条
[1]   Deep learning decision fusion for the classification of urban remote sensing data [J].
Abdi, Ghasem ;
Samadzadegan, Farhad ;
Reinartz, Peter .
JOURNAL OF APPLIED REMOTE SENSING, 2018, 12 (01)
[2]   Road Extraction from High-Resolution Orthophoto Images Using Convolutional Neural Network [J].
Abdollahi, Abolfazl ;
Pradhan, Biswajeet ;
Shukla, Nagesh .
JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2021, 49 (03) :569-583
[3]   A Hybrid Privacy-Preserving Deep Learning Approach for Object Classification in Very High-Resolution Satellite Images [J].
Boulila, Wadii ;
Khlifi, Manel Khazri ;
Ammar, Adel ;
Koubaa, Anis ;
Benjdira, Bilel ;
Farah, Imed Riadh .
REMOTE SENSING, 2022, 14 (18)
[4]   Multi-resolution segmentation parameters optimization and evaluation for VHR remote sensing image based on meanNSQI and discrepancy measure [J].
Chen, Yunhao ;
Chen, Qiang ;
Jing, Changfeng .
JOURNAL OF SPATIAL SCIENCE, 2021, 66 (02) :253-278
[5]  
[陈云浩 CHEN Yunhao], 2006, [武汉大学学报. 信息科学版, Geomatics and information science of wuhan university.], V31, P316
[6]   Application of a parallel spectral-spatial convolution neural network in object-oriented remote sensing land use classification [J].
Cui, Wei ;
Zheng, Zhendong ;
Zhou, Qi ;
Huang, Jiejun ;
Yuan, Yanbin .
REMOTE SENSING LETTERS, 2018, 9 (04) :334-342
[7]   Mapping Impervious Surfaces in Town-Rural Transition Belts Using China's GF-2 Imagery and Object-Based Deep CNNs [J].
Fu, Yongyong ;
Liu, Kunkun ;
Shen, Zhangquan ;
Deng, Jinsong ;
Gan, Muye ;
Liu, Xinguo ;
Lu, Dongming ;
Wang, Ke .
REMOTE SENSING, 2019, 11 (03)
[8]   Mask R-CNN and OBIA Fusion Improves the Segmentation of Scattered Vegetation in Very High-Resolution Optical Sensors [J].
Guirado, Emilio ;
Blanco-Sacristan, Javier ;
Rodriguez-Caballero, Emilio ;
Tabik, Siham ;
Alcaraz-Segura, Domingo ;
Martinez-Valderrama, Jaime ;
Cabello, Javier .
SENSORS, 2021, 21 (01) :1-17
[9]   Remote sensing image building detection method based on Mask R-CNN [J].
Han, Qinzhe ;
Yin, Qian ;
Zheng, Xin ;
Chen, Ziyi .
COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (03) :1847-1855
[10]   Intelligent Mapping of Urban Forests from High-Resolution Remotely Sensed Imagery Using Object-Based U-Net-DenseNet-Coupled Network [J].
He, Shaobai ;
Du, Huaqiang ;
Zhou, Guomo ;
Li, Xuejian ;
Mao, Fangjie ;
Zhu, Di'en ;
Xu, Yanxin ;
Zhang, Meng ;
Huang, Zihao ;
Liu, Hua ;
Luo, Xin .
REMOTE SENSING, 2020, 12 (23) :1-22