A Survey of Preprocessing Methods Used for Analysis of Big Data Originated From Smart Grids

被引:19
|
作者
Alghamdi, Turki Ali [1 ]
Javaid, Nadeem [2 ,3 ]
机构
[1] Umm Al Qura Univ, Coll Comp & Informat Syst, Dept Comp Sci, Mecca 21955, Saudi Arabia
[2] COMSATS Univ Islamabad CUI, Dept Comp Sci, Islamabad 44000, Pakistan
[3] Univ Technol Sydney UTS, Sch Comp Sci, Ultimo, NSW 2007, Australia
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Big Data; Mathematical models; Data preprocessing; Forecasting; Machine learning; Deep learning; Data models; Data analytics; data preprocessing; integration; normalization; smart grid; smart meter; transformation; AHEAD ELECTRICITY PRICES; ENERGY MANAGEMENT; LOAD; FORECAST; DEMAND; MODEL; METHODOLOGIES; PREDICTION; BUILDINGS; ALGORITHM;
D O I
10.1109/ACCESS.2022.3157941
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a brief survey of data preprocessing methods is presented. Specifically, the data preprocessing methods used in the smart grid (SG) domain are surveyed. Also, with the advent of SG, data collection on a large scale became possible. The data is essential for electricity demand, generation and price forecasting, which plays an important role in making energy efficient decisions, and long and short term predictions regarding energy generation, consumption and storage. However, the forecasting accuracy decreases when data is used in raw form. Hence, data preprocessing is considered essential. This paper provides an overview of the data preprocessing methods and a detailed discussion of the methods used in the existing literature. A comparison of the methods is also given. A survey of closely related survey papers is also presented and the papers are compared based on their contributions. Moreover, based on the discussion of the data preprocessing methods, a narrative is built with a critical analysis. Finally, future research directions are discussed to guide the readers.
引用
收藏
页码:29149 / 29171
页数:23
相关论文
共 50 条
  • [1] Big Data Issues in Smart Grids: A Survey
    Ghorbanian, Maedeh
    Dolatabadi, Sarineh Hacopian
    Siano, Pierluigi
    IEEE SYSTEMS JOURNAL, 2019, 13 (04): : 4158 - 4168
  • [2] Big Data from Smart Grids
    Bagheri, Azam
    Bollen, Math H. J.
    Gu, Irene Y. H.
    2017 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE EUROPE (ISGT-EUROPE), 2017,
  • [3] Evaluation of big data frameworks for analysis of smart grids
    Ansari, Mohammad Hasan
    Vakili, Vahid Tabatab
    Bahrak, Behnam
    JOURNAL OF BIG DATA, 2019, 6 (01)
  • [4] Evaluation of big data frameworks for analysis of smart grids
    Mohammad Hasan Ansari
    Vahid Tabatab Vakili
    Behnam Bahrak
    Journal of Big Data, 6
  • [5] BIG DATA PROCESSING FOR SMART GRIDS
    Benhaddou, Driss
    Abid, Mohamed Riduan
    Achahbar, Ouidad
    Khalil, Nacer
    Rachidi, Tajjeeddine
    Al Assaf, Maen
    IADIS-INTERNATIONAL JOURNAL ON COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2015, 10 (01): : 32 - 46
  • [6] Research into Big Data for Smart Grids
    Eze, E. C.
    Yang, T. C.
    Chatwin, C. R.
    Yue, D.
    Yu, H. N.
    2015 21ST INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC), 2015, : 365 - 370
  • [7] An Inclusive Survey on Data Preprocessing Methods Used in Web Usage Mining
    Bakariya, Brijesh
    Mohbey, Krishna K.
    Thakur, G. S.
    PROCEEDINGS OF SEVENTH INTERNATIONAL CONFERENCE ON BIO-INSPIRED COMPUTING: THEORIES AND APPLICATIONS (BIC-TA 2012), VOL 2, 2013, 202 : 407 - 416
  • [8] Big Data Solutions for Smart Grids and Smart Meters
    Konopko, Joanna
    MACHINE INTELLIGENCE AND BIG DATA IN INDUSTRY, 2016, 19 : 181 - 200
  • [9] Big data framework for analytics in smart grids
    Munshi, Amr A.
    Mohamed, Yasser A. -R. I.
    ELECTRIC POWER SYSTEMS RESEARCH, 2017, 151 : 369 - 380
  • [10] Big data analytics in smart grids: a review
    Zhang Y.
    Huang T.
    Bompard E.F.
    Energy Informatics, 1 (1)