A dual-branch network for crop-type mapping of scattered small agricultural fields in time series remote sensing images

被引:9
作者
Wu, Yanjun [1 ,2 ]
Peng, Zhenyue [1 ,2 ]
Hu, Yimin [2 ,3 ]
Wang, Rujing [2 ,3 ]
Xu, Taosheng [2 ,3 ]
机构
[1] Univ Sci & Technol China, Sci Isl Branch, Hefei, Peoples R China
[2] Chinese Acad Sci, Inst Intelligent Machines, Hefei Inst Phys Sci, Hefei, Peoples R China
[3] Zhongke Hefei Inst Collaborat Res & Innovat Intell, Agr Sensors & Intelligent Percept Technol Innovat, Hefei, Peoples R China
基金
国家重点研发计划;
关键词
Remote sensing; Time-series recognition; Dataset construction; Agricultural research; Scattered parcels; Deep learning; LAND-COVER; CLASSIFICATION; ACCURACY;
D O I
10.1016/j.rse.2024.114497
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid advancement of remote sensing technology, the recognition of agricultural field parcels using time-series remote sensing images has become an increasingly emphasized task. In this paper, we focus on identifying crops within scattered, irregular, and poorly defined agricultural fields in many Asian regions. We select two representative locations with small and scattered parcels and construct two new time-series remote sensing datasets (JM dataset and CF dataset). We propose a novel deep learning model DBL, the Dual- Branch Model with Long Short-Term Memory (LSTM), which utilizes main branch and supplementary branch to accomplish accurate crop-type mapping. The main branch is designed for capturing global receptive field and the supplementary is designed for temporal and spatial feature refinement. The experiments are conducted to evaluate the performance of the DBL compared with the state-of-the-art (SOTA) models. The results indicate that the DBL model performs exceptionally well on both datasets. Especially on the CF dataset characterized by scattered and irregular plots, the DBL model achieves an overall accuracy (OA) of 97.70% and a mean intersection over union (mIoU) of 90.70%. It outperforms all the SOTA models and becomes the only model to exceed 90% mark on the mIoU score. We also demonstrate the stability and robustness of the DBL across different agricultural regions.
引用
收藏
页数:15
相关论文
共 61 条
[1]  
Ballas Nicolas., 2015, arXiv
[2]   Remote sensing for irrigated agriculture: examples from research and possible applications [J].
Bastiaanssen, WGM ;
Molden, DJ ;
Makin, IW .
AGRICULTURAL WATER MANAGEMENT, 2000, 46 (02) :137-155
[3]   Remote Sensing and Cropping Practices: A Review [J].
Begue, Agnes ;
Arvor, Damien ;
Bellon, Beatriz ;
Betbeder, Julie ;
de Abelleyra, Diego ;
Ferraz, Rodrigo P. D. ;
Lebourgeois, Valentine ;
Lelong, Camille ;
Simoes, Margareth ;
Veron, Santiago R. .
REMOTE SENSING, 2018, 10 (01)
[4]   Evaluation of Deep Learning CNN Model for Land Use Land Cover Classification and Crop Identification Using Hyperspectral Remote Sensing Images [J].
Bhosle, Kavita ;
Musande, Vijaya .
JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2019, 47 (11) :1949-1958
[5]   Pointwise Convolutional Neural Networks [J].
Binh-Son Hua ;
Minh-Khoi Tran ;
Yeung, Sai-Kit .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :984-993
[6]   Understanding deep learning in land use classification based on Sentinel-2 time series [J].
Campos-Taberner, Manuel ;
Javier Garcia-Haro, Francisco ;
Martinez, Beatriz ;
Izquierdo-Verdiguier, Emma ;
Atzberger, Clement ;
Camps-Valls, Gustau ;
Amparo Gilabert, Maria .
SCIENTIFIC REPORTS, 2020, 10 (01)
[7]   Fully convolutional recurrent networks for multidate crop recognition from multitemporal image sequences [J].
Chamorro Martinez, Jorge Andres ;
Cue La Rosa, Laura Elena ;
Feitosa, Raul Queiroz ;
Sanches, Ieda Del'Arco ;
Happ, Patrick Nigri .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 171 :188-201
[8]   Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks [J].
Chen, Jierun ;
Kao, Shiu-Hong ;
He, Hao ;
Zhuo, Weipeng ;
Wen, Song ;
Lee, Chul-Ho ;
Chan, S. -H. Gary .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :12021-12031
[9]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, DOI 10.48550/ARXIV.1706.05587, 10.48550/arXiv.1706.05587]
[10]   GCSANet: A Global Context Spatial Attention Deep Learning Network for Remote Sensing Scene Classification [J].
Chen, Weitao ;
Ouyang, Shubing ;
Tong, Wei ;
Li, Xianju ;
Zheng, Xiongwei ;
Wang, Lizhe .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :1150-1162