IDUDL: Incremental Double Unsupervised Deep Learning Model for Marine Aquaculture SAR Images Segmentation

被引:18
作者
Wang, Xinzhe [1 ]
Zhou, Jianlin [1 ]
Fan, Jianchao [2 ,3 ]
机构
[1] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
[2] Natl Marine Environm Monitoring Ctr, Dept Ocean Remote Sensing, Dalian 116023, Peoples R China
[3] Dalian Univ Technol, Sch Control Sci & Engn, Dalian 116023, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Incremental learning; marine aquaculture; semantic segmentation; synthetic aperture radar (SAR); unsupervised deep learning; CLASSIFICATION;
D O I
10.1109/TGRS.2022.3203071
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Marine aquaculture is an important natural resource exploration that requires rational planning to avoid environmental damage. Synthetic aperture radar (SAR) images are essential in remote sensing to monitor the marine ecological environment. Unsupervised methods provide an adequate solution to avoid the cost of training sample collection. However, unsupervised methods often struggle to discover effective semantic information and incrementally use newly acquired data. To address these challenges, this article presents an incremental double unsupervised deep learning (IDUDL) model, which is specially designed to characterize unlabeled marine aquaculture and achieve the results semantically. Based on the idea of alternately generating and updating pseudo- labels, the proposed IDUDL model defines the double neural networks comprising the feature extraction network (FEN) and the fully convolutional semantic segmentation network (FCSSN). A patch estimation (PE) is proposed to generate pseudo-labels with aquaculture semantic information based on the features extracted by the FEN. Then, the aquaculture extraction results are obtained by FCSSN with generated pseudo-labels. After that, the pseudo-labels and extraction results are updated in turn until the pseudo-labels are stable. In addition, due to the unique structure of double neural networks, newly acquired marine aquaculture SAR images can also be added to the pretrained FCSSN and followed pseudo-labels updated based on the FEN and PE part, which can achieve new data incremental learning without retraining the whole IDUDL model. Experiments demonstrate the effectiveness of the proposed approach based on two different ways of marine aquaculture including raft and cage types, which consist of GaoFen-3 (GF-3) and RADARSAT-2 SAR images from the Dalian and Ningde areas, respectively. The incremental experiments are also designed to verify the generalization of the IDUDL model for newly obtained marine aquaculture SAR images. The code of this work will be available at https://github.com/fjc1575/MarineAquaculture/tree/main/IDUDL for the sake of reproducibility.
引用
收藏
页数:12
相关论文
共 43 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]  
Caron M, 2020, ADV NEUR IN, V33
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]  
Chen YZ, 2019, INT GEOSCI REMOTE SE, P8264, DOI [10.1109/igarss.2019.8897917, 10.1109/IGARSS.2019.8897917]
[7]   Research on a novel extraction method using Deep Learning based on GF-2 images for aquaculture areas [J].
Cheng, Bo ;
Liang, Chenbin ;
Liu, Xunan ;
Liu, Yueming ;
Ma, Xiaoxiao ;
Wang, Guizhou .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (09) :3575-3591
[8]   Extracting Raft Aquaculture Areas from Remote Sensing Images via an Improved U-Net with a PSE Structure [J].
Cui, Binge ;
Fei, Dong ;
Shao, Guanghui ;
Lu, Yan ;
Chu, Jialan .
REMOTE SENSING, 2019, 11 (17)
[9]  
Fan JC, 2019, 2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), P112, DOI [10.1109/ICICIP47338.2019.9012171, 10.1109/icicip47338.2019.9012171]
[10]   Marine Floating Raft Aquaculture Detection of GF-3 PolSAR Images Based on Collective Multikernel Fuzzy Clustering [J].
Fan, Jianchao ;
Zhao, Jianhua ;
An, Wentao ;
Hu, Yuanyuan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (08) :2741-2754