Assessing and Improving Sensors Data Quality in Streaming Context

被引:4
作者
El Sibai, Rayane [1 ]
Chabchoub, Yousra [1 ]
Chiky, Raja [1 ]
Demerjian, Jacques [2 ]
Barbar, Kablan [2 ]
机构
[1] ISEP, LlSITE Lab, F-92130 Issy Les Moulineaux, France
[2] Lebanese Univ, LARIFA EDST Lab, Fanar, Lebanon
来源
COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2017, PT II | 2017年 / 10449卷
关键词
Data quality; Sensor errors; Streaming data;
D O I
10.1007/978-3-319-67077-5_57
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An environmental monitoring process consists of a regular collection and analysis of sensors data streams. It aims to infer new knowledge about the environment, enabling the explorer to supervise the network and to take right decisions. Different data mining techniques are then applied to the collected data in order to infer aggregated statistics useful for anomalies detection and forecasting. The obtained results are closely dependent on the collected data quality. In fact, the data are often dirty, they contain noisy, erroneous and missing values. Poor data quality leads to defective and faulty results. One solution to overcome this problem will be presented in this paper. It consists of evaluating and improving the data quality, to be able to obtain reliable results. In this paper, we first introduce the data quality concept. Then, we discuss the existing related research studies. Finally, we propose a complete sensors data quality management system.
引用
收藏
页码:590 / 599
页数:10
相关论文
共 17 条
  • [1] Abuaitah G. R, 2015, TECHNOLOGICAL BREAKT, P172
  • [2] El Sibai R, 2016, 2016 INTERNATIONAL CONFERENCE ON DIGITAL ECONOMY (ICDEC), P29, DOI 10.1109/ICDEC.2016.7563142
  • [3] El Sibai R, 2015, 2015 IEEE SEVENTH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INFORMATION SYSTEMS (ICICIS), P487, DOI 10.1109/IntelCIS.2015.7397265
  • [4] Fan WF, 2015, SIGMOD REC, V44, P7, DOI 10.1145/2854006.2854008
  • [5] Jeffery SR, 2006, LECT NOTES COMPUT SC, V3968, P83
  • [6] Klein A., 2009, J Data Inf Qual, V1, P1, DOI DOI 10.1145/1577840.1577845
  • [7] Representing data quality for streaming and static data
    Klein, Anja
    Do, Hong-Hai
    Hackenbroich, Gregor
    Karnstedt, Marcel
    Lehner, Wolfgang
    [J]. 2007 IEEE 23RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOP, VOLS 1-2, 2007, : 3 - +
  • [8] Lim H., 2009, Proceedings of the 2nd SIGSPATIAL ACM GIS 2009 International Workshop on Security and Privacy in GIS and LBS, P58
  • [9] Olbrich S, 2010, AMCIS 2010 PROCEEDINGS
  • [10] Reliable data transport and congestion control in wireless sensor networks
    Department of Electrical and Computer Engineering, University of British Columbia, 2332 Main Mall, Vancouver, BC V6T 1Z4, Canada
    [J]. Int. J. Sens. Netw., 2008, 1 (16-24): : 16 - 24