Artificial Neural Networks for Real-Time Data Quality Assurance

被引:1
|
作者
Sousa I. [1 ]
Casimiro A. [1 ]
Cecílio J. [1 ]
机构
[1] Faculty of Sciences, University of Lisbon, Lisbon
来源
Ada User Journal | 2022年 / 43卷 / 02期
基金
欧盟地平线“2020”;
关键词
Data quality; Environmental monitoring; Forecasting; Neural networks; Sensor networks;
D O I
10.1145/3577949.3577966
中图分类号
学科分类号
摘要
Wireless Sensor Networks used in aquatic environments for continuous monitoring are typically subject to phys-ical or environmental factors that create anomalies in collected data. A possible approach to identify and correct these anomalies, hence to improve the quality of data, is to use artificial neural networks, as done by the previously proposed ANNODE (Artificial Neural Network-based Outlier Detection) framework [1]. In this paper we propose ANNODE+, which extends the ANNODE framework by detecting missing data in addition to outliers. We also describe the design and implementation of ANNODE+, implemented in Python to exploit readily available machine learning (ML) tools and libraries, also allowing online processing of incom-ing measurements. To evaluate the ANNODE+ capa-bilities, we used a dataset from a sensor deployment in Seixal’s bay, Portugal. This dataset includes measurements of water level, temperature and salinity. We observed that our implementation of ANNODE+ per-formed as intended, being able to detect injected anomalies and successfully correcting them. © 2022, Ada-Europe. All rights reserved.
引用
收藏
页码:117 / 120
页数:3
相关论文
共 50 条
  • [1] Real-Time Evaluation of Compaction Quality by Using Artificial Neural Networks
    Cao, Weidong
    Liu, Shutang
    Gao, Xuechi
    Ren, Fei
    Liu, Peng
    Wu, Qilun
    ADVANCES IN MATERIALS SCIENCE AND ENGINEERING, 2020, 2020
  • [2] Artificial neural networks for real-time scheduling
    Nureldin, HM
    O'Connor, RF
    Duffill, AW
    ADVANCES IN MANUFACTURING TECHNOLOGY XII, 1998, : 251 - 256
  • [3] Quality Assurance / Quality Control of Real-Time Oceanographic Data
    Bushnell, Mark
    OCEANS 2016 MTS/IEEE MONTEREY, 2016,
  • [4] DEVELOPMENT OF ARTIFICIAL NEURAL NETWORKS FOR REAL-TIME, INSITU ELLIPSOMETRY DATA REDUCTION
    URBAN, FK
    PARK, DC
    TABET, MF
    THIN SOLID FILMS, 1992, 220 (1-2) : 247 - 253
  • [5] DRESS REHEARSAL FOR REAL-TIME ARTIFICIAL NEURAL NETWORKS
    CHESTER, M
    ELECTRONIC PRODUCTS MAGAZINE, 1987, 30 (02): : 19 - +
  • [6] Real-time load forecasting by artificial neural networks
    Sharif, SS
    Taylor, JH
    2000 IEEE POWER ENGINEERING SOCIETY SUMMER MEETING, CONFERENCE PROCEEDINGS, VOLS 1-4, 2000, : 496 - 501
  • [7] REAL-TIME TRACK IDENTIFICATION WITH ARTIFICIAL NEURAL NETWORKS
    ATHANASIU, G
    PAVLOPOULOS, P
    VLACHOS, S
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 1993, 324 (1-2): : 320 - 329
  • [8] Real-time data reassurance in electrical power systems based on artificial neural networks
    Mousavian, Seyedamirabbas
    Valenzuela, Jorge
    Wang, Jianhui
    ELECTRIC POWER SYSTEMS RESEARCH, 2013, 96 : 285 - 295
  • [9] Real-Time Face Detection Using Artificial Neural Networks
    Aulestia, Pablo S.
    Talahua, Jonathan S.
    Andaluz, Victor H.
    Benalcazar, Marco E.
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, PT II, 2017, 10614 : 590 - 599
  • [10] Application of Artificial Neural Networks for real time data compression
    D'Souza, W
    Spracklen, T
    8TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING, VOLS 1-3, PROCEEDING, 2001, : 689 - 692