Deep learning-based object recognition in multispectral satellite imagery for real-time applications

被引:15
作者
Gudzius, Povilas [1 ]
Kurasova, Olga [1 ]
Darulis, Vytenis [1 ]
Filatovas, Ernestas [1 ]
机构
[1] Vilnius Univ, Inst Data Sci & Digital Technol, Akad St 4, LT-08412 Vilnius, Lithuania
关键词
VEHICLE DETECTION; TARGET DETECTION; TRENDS;
D O I
10.1007/s00138-021-01209-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Satellite imagery is changing the way we understand and predict economic activity in the world. Advancements in satellite hardware and low-cost rocket launches have enabled near-real-time, high-resolution images covering the entire Earth. It is too labour-intensive, time-consuming and expensive for human annotators to analyse petabytes of satellite imagery manually. Current computer vision research exploring this problem still lack accuracy and prediction speed, both significantly important metrics for latency-sensitive automatized industrial applications. Here we address both of these challenges by proposing a set of improvements to the object recognition model design, training and complexity regularisation, applicable to a range of neural networks. Furthermore, we propose a fully convolutional neural network (FCN) architecture optimised for accurate and accelerated object recognition in multispectral satellite imagery. We show that our FCN exceeds human-level performance with state-of-the-art 97.67% accuracy over multiple sensors, it is able to generalize across dispersed scenery and outperforms other proposed methods to date. Its computationally light architecture delivers a fivefold improvement in training time and a rapid prediction, essential to real-time applications. To illustrate practical model effectiveness, we analyse it in algorithmic trading environment. Additionally, we publish a proprietary annotated satellite imagery dataset for further development in this research field. Our findings can be readily implemented for other real-time applications too.
引用
收藏
页数:14
相关论文
共 65 条
[1]   Efficient object detection and segmentation for fine-grained recognition [J].
Angelova, Anelia ;
Zhu, Shenghuo .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :811-818
[2]   Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
REMOTE SENSING, 2017, 9 (04)
[3]   Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community [J].
Ball, John E. ;
Anderson, Derek T. ;
Chan, Chee Seng .
JOURNAL OF APPLIED REMOTE SENSING, 2017, 11
[4]   Who launched what, when and why; trends in global land-cover observation capacity from civilian earth observation satellites [J].
Belward, Alan S. ;
Skoien, Jon O. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2015, 103 :115-128
[5]  
Canziani A, 2016, ARXIV
[6]   Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks [J].
Chen, Xueyun ;
Xiang, Shiming ;
Liu, Cheng-Lin ;
Pan, Chun-Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (10) :1797-1801
[7]   A recursive thresholding technique for image segmentation [J].
Cheriet, M ;
Said, JN ;
Suen, CY .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (06) :918-921
[8]  
Cliff D., 2011, Technology trends in the financial markets: a 2020 vision
[9]  
Cong Jason, 2014, Artificial Neural Networks and Machine Learning - ICANN 2014. 24th International Conference on Artificial Neural Networks. Proceedings: LNCS 8681, P281, DOI 10.1007/978-3-319-11179-7_36
[10]   Near real time satellite imagery to support and verify timely flood modelling [J].
Di Baldassarre, Giuliano ;
Schumann, Guy ;
Bates, Paul .
HYDROLOGICAL PROCESSES, 2009, 23 (05) :799-803