Transfer learning in environmental remote sensing

被引:174
作者
Ma, Yuchi [1 ,2 ]
Chen, Shuo [3 ]
Ermon, Stefano [4 ]
Lobell, David B. [1 ,2 ]
机构
[1] Stanford Univ, Dept Earth Syst Sci, 473 Via Ortega Dr, Stanford, CA 94305 USA
[2] Stanford Univ, Ctr Food Secur & Environm, Stanford, CA 94305 USA
[3] Purdue Univ, Dept Earth Atmospher & Planetary Sci, W Lafayette, IN 47907 USA
[4] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
关键词
Remote sensing; Domain shift; Transfer learning; Unsupervised domain adaptation; Multi-task learning; Few-shot learning; Self-supervised learning; UNSUPERVISED DOMAIN ADAPTATION; NEURAL-NETWORK; CLASSIFICATION; VARIABILITY; FOREST;
D O I
10.1016/j.rse.2023.113924
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Machine learning (ML) has proven to be a powerful tool for utilizing the rapidly increasing amounts of remote sensing data for environmental monitoring. Yet ML models often require a substantial amount of ground truth labels for training, and models trained using labeled data from one domain often demonstrate poor performance when directly applied to other domains. Transfer learning (TL) has emerged as a promising strategy to address domain shift and alleviate the need for labeled data. Here we provide the first systematic review of TL studies in environmental remote sensing. We start by defining the different forms of domain shift and then describe five commonly used TL techniques. We then present the results of a systematic search for peer-reviewed articles published between 2017 and 2022, which identified 1676 papers. Applications of TL in remote sensing have increased rapidly, with nearly 10 times more publications in 2022 than in 2017. Across seven categories of applications (land cover mapping, vegetation monitoring, soil property estimation, crop yield prediction, biodiversity monitoring, water resources management, and natural disaster management) we identify several recent successes of TL as well as some remaining research gaps. Finally, we highlight the need to organize benchmark datasets explicitly for TL in remote sensing for model evaluation. We also discuss potential research directions for TL studies in environmental remote sensing, such as realizing scale transfer, improving model interpretability, and leveraging foundation models for remote sensing tasks.
引用
收藏
页数:22
相关论文
共 204 条
[1]   Tomato plant disease detection using transfer learning with C-GAN synthetic images [J].
Abbas, Amreen ;
Jain, Sweta ;
Gour, Mahesh ;
Vankudothu, Swetha .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 187
[2]   Fine-tuning convolutional neural network with transfer learning for semantic segmentation of ground-level oilseed rape images in a field with high weed pressure [J].
Abdalla, Alwaseela ;
Cen, Haiyan ;
Wan, Liang ;
Rashid, Reem ;
Weng, Haiyong ;
Zhou, Weijun ;
He, Yong .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 167
[3]   Earth Observation and Biodiversity Big Data for Forest Habitat Types Classification and Mapping [J].
Agrillo, Emiliano ;
Filipponi, Federico ;
Pezzarossa, Alice ;
Casella, Laura ;
Smiraglia, Daniela ;
Orasi, Arianna ;
Attorre, Fabio ;
Taramelli, Andrea .
REMOTE SENSING, 2021, 13 (07)
[4]   Automatic detection of passable roads after floods in remote sensed and social media data [J].
Ahmad, Kashif ;
Pogorelov, Konstantin ;
Riegler, Michael ;
Ostroukhova, Olga ;
Halvorsen, Pal ;
Conci, Nicola ;
Dahyot, Rozenn .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 74 :110-118
[5]  
Ahmadi M, 2024, Arxiv, DOI arXiv:2304.12600
[6]   A Multi-Step Approach for Optically Active and Inactive Water Quality Parameter Estimation Using Deep Learning and Remote Sensing [J].
Ahmed, Mehreen ;
Mumtaz, Rafia ;
Anwar, Zahid ;
Shaukat, Arslan ;
Arif, Omar ;
Shafait, Faisal .
WATER, 2022, 14 (13)
[7]   Construction of small sample seismic landslide susceptibility evaluation model based on Transfer Learning: a case study of Jiuzhaigou earthquake [J].
Ai, Xiao ;
Sun, Baitao ;
Chen, Xiangzhao .
BULLETIN OF ENGINEERING GEOLOGY AND THE ENVIRONMENT, 2022, 81 (03)
[8]   Airborne Optical and Thermal Remote Sensing for Wildfire Detection and Monitoring [J].
Allison, Robert S. ;
Johnston, Joshua M. ;
Craig, Gregory ;
Jennings, Sion .
SENSORS, 2016, 16 (08)
[9]   Geography-Aware Self-Supervised Learning [J].
Ayush, Kumar ;
Uzkent, Burak ;
Meng, Chenlin ;
Tanmay, Kumar ;
Burke, Marshall ;
Lobell, David ;
Ermon, Stefano .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :10161-10170
[10]  
Bastani F, 2023, Arxiv, DOI arXiv:2211.15660