Apache Spark a Big Data Analytics Platform for Smart Grid

被引:79
|
作者
Shyam, R. [1 ]
Ganesh, Bharathi H. B. [1 ]
Kumar, Sachin S. [1 ]
Poornachandran, Prabaharan [2 ]
Soman, K. P. [1 ]
机构
[1] Amrita Vishwa Vidyapeetha, Ctr Excellence Computat Engn & Networking, Coimbatore 641112, Tamil Nadu, India
[2] Amrita Vishwa Vidyapeetham, Amrita Ctr Cyber Secur Syst & Networks, Kollam, India
来源
关键词
Smart Grid; Data Analytics; Big Data; Apache Spark;
D O I
10.1016/j.protcy.2015.10.085
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Smart grid is a complete automation system, where large pool of sensors is embedded in the existing power grids system for controlling and monitoring it by utilizing modern information technologies. The data collected from these sensors are huge and have all the characteristics to be called as Big Data. The Smart-grid can be made more intelligent by processing and deriving new information from these data in real time. This paper presents Apache spark as a unified cluster computing platform which is suitable for storing and performing Big Data analytics on smart grid data for applications like automatic demand response and real time pricing. (C) 2015 Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:171 / 178
页数:8
相关论文
共 50 条
  • [1] Big data analytics on Apache Spark
    Salloum S.
    Dautov R.
    Chen X.
    Peng P.X.
    Huang J.Z.
    International Journal of Data Science and Analytics, 2016, 1 (3-4) : 145 - 164
  • [2] Big Data Software Analytics with Apache Spark
    Gousios, Georgios
    PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION, 2018, : 542 - 543
  • [3] Big Data Analytics for the ATLAS EventIndex Project with Apache Spark
    Casani, Alvaro Fernandez
    Montoro, Carlos Garcia
    de la Hoz, Santiago Gonzalez
    Salt, Jose
    Sanchez, Javier
    Perez, Miguel Villaplana
    COMPUTATIONAL AND MATHEMATICAL METHODS, 2023, 2023
  • [4] A Big Data Analysis Platform for Healthcare on Apache Spark
    Zhang, Jinwei
    Zhang, Yong
    Hu, Qingcheng
    Tian, Hongliang
    Xing, Chunxiao
    SMART HEALTH, ICSH 2016, 2017, 10219 : 32 - 43
  • [5] BigDebug: Interactive Debugger for Big Data Analytics in Apache Spark
    Gulzar, Muhammad Ali
    Interlandi, Matteo
    Condie, Tyson
    Kim, Miryung
    FSE'16: PROCEEDINGS OF THE 2016 24TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON FOUNDATIONS OF SOFTWARE ENGINEERING, 2016, : 1033 - 1037
  • [6] Mobile Big Data Analytics Using Deep Learning and Apache Spark
    Abu Alsheikh, Mohammad
    Niyato, Dusit
    Lin, Shaowei
    Tan, Hwee-Pink
    Han, Zhu
    IEEE NETWORK, 2016, 30 (03): : 22 - 29
  • [7] Big data Predictive Analytics for Apache Spark using Machine Learning
    Junaid, Muhammad
    Wagan, Shiraz Ali
    Qureshi, Nawab Muhammad Faseeh
    Nam, Choon Sung
    Shin, Dong Ryeol
    2020 GLOBAL CONFERENCE ON WIRELESS AND OPTICAL TECHNOLOGIES (GCWOT), 2020,
  • [8] A Big Data platform for smart meter data analytics
    Wilcox, Tom
    Jin, Nanlin
    Flach, Peter
    Thumim, Joshua
    COMPUTERS IN INDUSTRY, 2019, 105 : 250 - 259
  • [9] big data analytics making the smart grid smarter
    Hong, Tao
    IEEE POWER & ENERGY MAGAZINE, 2018, 16 (03): : 12 - 16
  • [10] Predictors of outpatients' no-show: big data analytics using apache spark
    Daghistani, Tahani
    AlGhamdi, Huda
    Alshammari, Riyad
    AlHazme, Raed H.
    JOURNAL OF BIG DATA, 2020, 7 (01)