A Bad Data Identification Method for Multiple Spatio-temporal Data in Power Distribution Network

被引:0
|
作者
Hu, Lijuan [1 ]
Sheng, Wanxing [1 ]
Liu, Keyan [1 ]
Lin, Zhi [2 ]
机构
[1] China Elect Power Res Inst, Guangzhou, Guangdong, Peoples R China
[2] North China Elect Power Univ, Guangzhou, Guangdong, Peoples R China
来源
2018 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON) | 2018年
关键词
Distribution network; Spatio-temporal Data; Bad Data Identification; Hadoop parallelization;
D O I
暂无
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Due to the excessive number of databases, unbalanced development and behindhand sensing infrastructures, distributed network data suffers from inconsistency, data missing, large measurement error and other data quality problems, which hinder the development of smart distribution network. In order to discover more complex deep-seated rules and provide more effective decision support for power system decision-making, it is necessary to study data mining and analysis methods that are suitable for massive data under current situation. This paper studies on the method of identifying bad data for multi-temporal and multi-spatial data in distribution networks and propose a method to identify bad data using likelihood-ratio test for 3D spatio-temporal data. In order to speed up the data processing rate, a 3D-LRT method based on multi-threading and Hadoop parallelization methods is proposed.
引用
收藏
页码:4083 / 4088
页数:6
相关论文
共 50 条
  • [1] A Data Cleaning Method on Massive Spatio-Temporal Data
    Ding, Weilong
    Cao, Yaqi
    ADVANCES IN SERVICES COMPUTING, 2016, 10065 : 173 - 182
  • [2] A Spatio-temporal Data Compression Algorithm
    Wang, Lei
    Guo, Yiming
    Chen, Chen
    Yan, Yaowei
    2012 FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION NETWORKING AND SECURITY (MINES 2012), 2012, : 421 - 424
  • [3] Integration of Spatio-Temporal Data in a DBMS
    Abd Rahim, Yahaya
    Sahib, Shahrin
    Mastura, Siti
    2010 SECOND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATIONS: ICCEA 2010, PROCEEDINGS, VOL 2, 2010, : 384 - 388
  • [4] Spatio-temporal Data Revision: A Review
    Deng Xiaoguang
    Wu Huayi
    Li Deren
    GEOINFORMATICS 2008 AND JOINT CONFERENCE ON GIS AND BUILT ENVIRONMENT: ADVANCED SPATIAL DATA MODELS AND ANALYSES, PARTS 1 AND 2, 2009, 7146
  • [5] Computing the Relative Value of Spatio-Temporal Data in Data Marketplaces
    Andres Azcoitia, Santiago
    Paraschiv, Marius
    Laoutaris, Nikolaos
    30TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2022, 2022, : 165 - 175
  • [6] Massive GIS Spatio-temporal Data Storage Method in Cloud Environment
    Yu, Bin
    Zhang, Chen
    Sun, Jiangyan
    Zhang, Yu
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 105 - 109
  • [7] Exploratory spatio-temporal data mining and visualization
    Compieta, P.
    Di Martino, S.
    Bertolotto, M.
    Ferrucci, F.
    Kechadi, T.
    JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2007, 18 (03) : 255 - 279
  • [8] Evaluation Procedures for Forecasting with Spatio-Temporal Data
    Oliveira, Mariana
    Torgo, Luis
    Costa, Vitor Santos
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT I, 2019, 11051 : 703 - 718
  • [9] A sandwich smoother for spatio-temporal functional data
    French, Joshua P.
    Kokoszka, Piotr S.
    SPATIAL STATISTICS, 2021, 42
  • [10] Managing Spatio-Temporal Data Streams on AUVs
    Werner, Tobias
    Brinkhoff, Thomas
    2018 IEEE/OES AUTONOMOUS UNDERWATER VEHICLE WORKSHOP (AUV), 2018,