End-to-end system for monitoring the state of rivers using a drone

被引:1
作者
Prokop, Katarzyna [1 ]
Polap, Karolina [2 ]
Wlodarczyk-Sielicka, Marta [3 ]
Jaszcz, Antoni [1 ,2 ]
机构
[1] Silesian Tech Univ, Fac Appl Math, Gliwice, Poland
[2] Marine Technol Ltd, Gdynia, Poland
[3] Maritime Univ Szczecin, Fac Nav, Szczecin, Poland
关键词
river monitoring; remote sensing; image processing; drones; VGG16; end-to-end system;
D O I
10.3389/fenvs.2023.1303067
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Automatic data analysis systems in the Internet of Things are a key element. One such case is the use of drones to monitor rivers, which are quite often located around built-up areas. This is an important element for the analysis of urban areas that are exposed to various environmental challenges such as pollution and animal habitats. Data analysis allows the detection of anomalies in the state of rivers, reducing the risk of ecological disasters or even floods. Additionally, constant control of areas enables analysis of the impact of urbanization on a given area as well as environmental protection. In this paper, we propose an end-to-end system, where the user performs measurements with a drone and the result is a segmentation mask from the U-Net network, but improved by image processing algorithms. The system is based on performing segmentation with a neural network, imposing the obtained mask on the image that was previously subjected to edge detection. All pixels under the mask are analyzed by the clustering method in terms of belonging to a river or bank. In addition, when there are other measurements from the same area, they are used to compare and analyze changes. The proposed system architecture is based on the automation of activities due to the combination of various graphics processing methods. Moreover, the method allows for obtaining more accurate segmentation results than classic methods. The proposition was tested on data gathered near river areas in southern Poland to show the possibilities and effectiveness of the system. Proposed methodology reached 0.8524 of Dice coefficient using VGG16 as encoder.
引用
收藏
页数:11
相关论文
共 50 条
[31]   End-to-End Learning-Based Image Compression: A Review [J].
Chen Jimin ;
Lin Zehao .
LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (22)
[32]   LEARNING ENVIRONMENTAL SOUNDS WITH END-TO-END CONVOLUTIONAL NEURAL NETWORK [J].
Tokozume, Yuji ;
Harada, Tatsuya .
2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, :2721-2725
[33]   End-to-end Dynamic Stream Processing on Maxeler HLS Platforms [J].
Kritikakis, Charalampos ;
Koch, Dirk .
2019 IEEE 30TH INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP 2019), 2019, :59-66
[34]   End-to-end compensation of digital-optical imaging systems [J].
Robinson, M. Dirk ;
Stork, David G. .
CURRENT DEVELOPMENTS IN LENS DESIGN AND OPTICAL ENGINEERING VII, 2006, 6288
[35]   DeepISP: Toward Learning an End-to-End Image Processing Pipeline [J].
Schwartz, Eli ;
Giryes, Raja ;
Bronstein, Alex M. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (02) :912-923
[36]   Lattice Based Transcription Loss for End-to-End Speech Recognition [J].
Kang, Jian ;
Zhang, Wei-Qiang ;
Liu, Wei-Wei ;
Liu, Jia ;
Johnson, Michael T. .
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2018, 90 (07) :1013-1023
[37]   Lattice Based Transcription Loss for End-to-End Speech Recognition [J].
Kang, Jian ;
Zhang, Wei-Qiang ;
Liu, Jia .
2016 10TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2016,
[38]   The Digital Simulation of End-To-End Imaging Chain in Optical Remote Sensing System Based on MTF Models [J].
Bu, Fan ;
Qiu, Yuehong ;
Yao, Dalei ;
Jiang, Baotan .
PROCEEDINGS OF 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2015), 2015, :328-333
[39]   Lattice Based Transcription Loss for End-to-End Speech Recognition [J].
Jian Kang ;
Wei-Qiang Zhang ;
Wei-Wei Liu ;
Jia Liu ;
Michael T. Johnson .
Journal of Signal Processing Systems, 2018, 90 :1013-1023
[40]   ERROR ANALYSIS APPLIED TO END-TO-END SPOKEN LANGUAGE UNDERSTANDING [J].
Caubriere, Antoine ;
Ghannay, Sahar ;
Tomashenko, Natalia ;
De Mori, Renato ;
Laurent, Antoine ;
Morin, Emmanuel ;
Esteve, Yannick .
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, :8514-8518