Artificial Neural Networks for Real-Time Data Quality Assurance

被引:0
作者
Sousa I. [1 ]
Casimiro A. [1 ]
Cecílio J. [1 ]
机构
[1] Faculty of Sciences, University of Lisbon, Lisbon
来源
Ada User Journal | 2022年 / 43卷 / 02期
基金
欧盟地平线“2020”;
关键词
Data quality; Environmental monitoring; Forecasting; Neural networks; Sensor networks;
D O I
10.1145/3577949.3577966
中图分类号
学科分类号
摘要
Wireless Sensor Networks used in aquatic environments for continuous monitoring are typically subject to phys-ical or environmental factors that create anomalies in collected data. A possible approach to identify and correct these anomalies, hence to improve the quality of data, is to use artificial neural networks, as done by the previously proposed ANNODE (Artificial Neural Network-based Outlier Detection) framework [1]. In this paper we propose ANNODE+, which extends the ANNODE framework by detecting missing data in addition to outliers. We also describe the design and implementation of ANNODE+, implemented in Python to exploit readily available machine learning (ML) tools and libraries, also allowing online processing of incom-ing measurements. To evaluate the ANNODE+ capa-bilities, we used a dataset from a sensor deployment in Seixal’s bay, Portugal. This dataset includes measurements of water level, temperature and salinity. We observed that our implementation of ANNODE+ per-formed as intended, being able to detect injected anomalies and successfully correcting them. © 2022, Ada-Europe. All rights reserved.
引用
收藏
页码:117 / 120
页数:3
相关论文
共 6 条
[1]  
Using machine learning for dependable outlier detection in environmental monitoring systems,”, ACM Trans. Cyber-Phys. Syst, 5, (2021)
[2]  
O'Flyrm B., Martinez R., Cleary J., Slater C., Regan F., Diamond D., Murphy H., Smartcoast: A Wireless Sensor Network for Water Quality monitoring,”, 11, pp. 815-816, (2007)
[3]  
Jesus G., Casimiro A., Oliveira A., A survey on data quality for dependable monitoring in wireless sensor networks, Sensors, 17, 9, (2017)
[4]  
Teh H., Kempa-Liehr A., Wang K., Sensor data quality: A systematic review, Journal of Big Data, 7, 2, (2020)
[5]  
Managing a coastal sensors network in a nowcast-forecast information system, In 2013 Eighth International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 518-523, (2013)
[6]  
Brentan B., Meirelles G., Herrera M., Luvizotto E., Izquierdo J., Correlation analysis of water demand and predictive variables for short-term forecasting models, Mathematical Problems in Engineering, 12, (2017)