A Survey of Preprocessing Methods Used for Analysis of Big Data Originated From Smart Grids

被引:20
作者
Alghamdi, Turki Ali [1 ]
Javaid, Nadeem [2 ,3 ]
机构
[1] Umm Al Qura Univ, Coll Comp & Informat Syst, Dept Comp Sci, Mecca 21955, Saudi Arabia
[2] COMSATS Univ Islamabad CUI, Dept Comp Sci, Islamabad 44000, Pakistan
[3] Univ Technol Sydney UTS, Sch Comp Sci, Ultimo, NSW 2007, Australia
关键词
Big Data; Mathematical models; Data preprocessing; Forecasting; Machine learning; Deep learning; Data models; Data analytics; data preprocessing; integration; normalization; smart grid; smart meter; transformation; AHEAD ELECTRICITY PRICES; ENERGY MANAGEMENT; LOAD; FORECAST; DEMAND; MODEL; METHODOLOGIES; PREDICTION; BUILDINGS; ALGORITHM;
D O I
10.1109/ACCESS.2022.3157941
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a brief survey of data preprocessing methods is presented. Specifically, the data preprocessing methods used in the smart grid (SG) domain are surveyed. Also, with the advent of SG, data collection on a large scale became possible. The data is essential for electricity demand, generation and price forecasting, which plays an important role in making energy efficient decisions, and long and short term predictions regarding energy generation, consumption and storage. However, the forecasting accuracy decreases when data is used in raw form. Hence, data preprocessing is considered essential. This paper provides an overview of the data preprocessing methods and a detailed discussion of the methods used in the existing literature. A comparison of the methods is also given. A survey of closely related survey papers is also presented and the papers are compared based on their contributions. Moreover, based on the discussion of the data preprocessing methods, a narrative is built with a critical analysis. Finally, future research directions are discussed to guide the readers.
引用
收藏
页码:29149 / 29171
页数:23
相关论文
共 50 条
[21]   A Survey of Machine Learning Methods for Big Data [J].
Ruiz, Zoila ;
Salvador, Jaime ;
Garcia-Rodriguez, Jose .
BIOMEDICAL APPLICATIONS BASED ON NATURAL AND ARTIFICIAL COMPUTING, PT II, 2017, 10338 :259-267
[22]   Data Lake Lambda Architecture for Smart Grids Big Data Analytics [J].
Munshi, Amr A. ;
Mohamed, Yasser Abdel-Rady I. .
IEEE ACCESS, 2018, 6 :40463-40471
[23]   Adaptive Energy Management of Big Data Analytics in Smart Grids [J].
Gupta, Rohit ;
Chaturvedi, Krishna Teerth .
ENERGIES, 2023, 16 (16)
[24]   Big Data Analytics for Price and Load Forecasting in Smart Grids [J].
Mujeeb, Sana ;
Javaid, Nadeem ;
Akbar, Mariam ;
Khalid, Rabiya ;
Nazeer, Orooj ;
Khan, Mahnoor .
ADVANCES ON BROADBAND AND WIRELESS COMPUTING, COMMUNICATION AND APPLICATIONS, BWCCA-2018, 2019, 25 :77-87
[25]   Compression of smart meter big data: A survey [J].
Wen, Lulu ;
Zhou, Kaile ;
Yang, Shanlin ;
Li, Lanlan .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 91 :59-69
[26]   A Survey of Big Data Analytics for Smart Forestry [J].
Zou, Weitao ;
Jing, Weipeng ;
Chen, Guangsheng ;
Lu, Yang ;
Song, Houbing .
IEEE ACCESS, 2019, 7 :46621-46636
[27]   Energy Theft in Smart Grids: A Survey on Data-Driven Attack Strategies and Detection Methods [J].
Althobaiti, Ahlam ;
Jindal, Anish ;
Marnerides, Angelos K. ;
Roedig, Utz .
IEEE ACCESS, 2021, 9 :159291-159312
[28]   Renewable energy management in smart grids by using big data analytics and machine learning [J].
Mostafa, Noha ;
Ramadan, Haitham Saad Mohamed ;
Elfarouk, Omar .
MACHINE LEARNING WITH APPLICATIONS, 2022, 9
[29]   Smart electrical grids based on cloud, IoT, and big data technologies: state of the art [J].
Rabie, Asmaa H. ;
Saleh, Ahmed, I ;
Ali, Hesham A. .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (10) :9449-9480
[30]   A Survey on Cost Saving Methods for Smart Grids [J].
Alam, Muhammad Raisul ;
St-Hilaire, Marc ;
Kunz, Thomas .
2013 IEEE INTERNATIONAL CONFERENCE ON SMART ENERGY GRID ENGINEERING (SEGE), 2013,