Artificial Neural Networks for Real-Time Data Quality Assurance

被引:1
作者
Sousa I. [1 ]
Casimiro A. [1 ]
Cecílio J. [1 ]
机构
[1] Faculty of Sciences, University of Lisbon, Lisbon
来源
Ada User Journal | 2022年 / 43卷 / 02期
基金
欧盟地平线“2020”;
关键词
Data quality; Environmental monitoring; Forecasting; Neural networks; Sensor networks;
D O I
10.1145/3577949.3577966
中图分类号
学科分类号
摘要
Wireless Sensor Networks used in aquatic environments for continuous monitoring are typically subject to phys-ical or environmental factors that create anomalies in collected data. A possible approach to identify and correct these anomalies, hence to improve the quality of data, is to use artificial neural networks, as done by the previously proposed ANNODE (Artificial Neural Network-based Outlier Detection) framework [1]. In this paper we propose ANNODE+, which extends the ANNODE framework by detecting missing data in addition to outliers. We also describe the design and implementation of ANNODE+, implemented in Python to exploit readily available machine learning (ML) tools and libraries, also allowing online processing of incom-ing measurements. To evaluate the ANNODE+ capa-bilities, we used a dataset from a sensor deployment in Seixal’s bay, Portugal. This dataset includes measurements of water level, temperature and salinity. We observed that our implementation of ANNODE+ per-formed as intended, being able to detect injected anomalies and successfully correcting them. © 2022, Ada-Europe. All rights reserved.
引用
收藏
页码:117 / 120
页数:3
相关论文
共 50 条
  • [1] Automatic processing, quality assurance and serving of real-time weather data
    Williams, Matthew
    Cornford, Dan
    Bastin, Lucy
    Jones, Richard
    Parker, Stephen
    COMPUTERS & GEOSCIENCES, 2011, 37 (03) : 353 - 362
  • [2] Real-time Monitoring Of Gas Pipeline Through Artificial Neural Networks
    Santos, R. B.
    de Sousa, E. O.
    da Silva, F. V.
    da Cruz, S. L.
    Fileti, A. M. F.
    2013 1ST BRICS COUNTRIES CONGRESS ON COMPUTATIONAL INTELLIGENCE AND 11TH BRAZILIAN CONGRESS ON COMPUTATIONAL INTELLIGENCE (BRICS-CCI & CBIC), 2013, : 329 - 334
  • [3] Modeling Data Quality Using Artificial Neural Networks
    Laufer, Ralf
    Schwieger, Volker
    1ST INTERNATIONAL WORKSHOP ON THE QUALITY OF GEODETIC OBSERVATION AND MONITORING SYSTEMS (QUGOMS'11), 2015, 140 : 3 - 8
  • [4] A real-time classification system of thalassemic pathologies based on artificial neural networks
    Amendolia, SR
    Brunetti, A
    Carta, P
    Cossu, G
    Ganadu, ML
    Golosio, B
    Mura, GM
    Pirastru, MG
    MEDICAL DECISION MAKING, 2002, 22 (01) : 18 - 26
  • [5] Supervision controller for real-time surface quality assurance in CNC machining using artificial intelligence
    Moreira, L. C.
    Li, W. D.
    Lu, X.
    Fitzpatrick, M. E.
    COMPUTERS & INDUSTRIAL ENGINEERING, 2019, 127 : 158 - 168
  • [6] Real-Time Pricing and Hedging of Options on Currency Futures with Artificial Neural Networks
    von Spreckelsen, Christian
    von Mettenheim, Hans-Joerg
    Breitner, Michael H.
    JOURNAL OF FORECASTING, 2014, 33 (06) : 419 - 432
  • [7] An approach to implement electricity metering in real-time using artificial neural networks
    Dondo, MC
    El-Hawary, ME
    IEEE TRANSACTIONS ON POWER DELIVERY, 2003, 18 (02) : 383 - 386
  • [8] Use of Artificial Neural Networks for Real-Time Prediction of Heave Displacement in Ocean Buoys
    Shoori J., Hesam E.
    Ling, Bradely
    Batten, Belinda A.
    2014 INTERNATIONAL CONFERENCE ON RENEWABLE ENERGY RESEARCH AND APPLICATION (ICRERA), 2014, : 907 - 912
  • [9] Neural networks and evolutionary computation for real-time quality control of complex processes
    Patro, S
    Kolarik, WJ
    ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM - 1997 PROCEEDINGS: THE INTERNATIONAL SYMPOSIUM ON PRODUCT QUALITY & INTEGRITY, 1997, : 327 - 332
  • [10] Designing Neural Networks for Real-Time Systems
    Pearce, Hammond
    Yang, Xin
    Roop, Partha S.
    Katzef, Marc
    Strom, Torur Biskopsto
    IEEE EMBEDDED SYSTEMS LETTERS, 2021, 13 (03) : 94 - 97