Research on Parallel Processing Framework of Power Big Data

被引：3

作者：

Hu Bin ^{[1
]}

Luo Li-ming ^{[1
]}

Yang Pei ^{[1
]}

Huang Tai-gui ^{[2
]}

Zhang Li-ping ^{[3
]}

机构：

[1] Global Energy Interconnect Res Inst, Beijing 102209, Peoples R China

[2] State Grid Anhui Elect Power Co, Hefei 230061, Anhui, Peoples R China

[3] Nanjing Univ Post & Telecommun, Nanjing 210003, Jiangsu, Peoples R China

来源：

2017 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL SYSTEMS AND COMMUNICATIONS (ICCSC 2017) | 2017年

关键词：

Power big data; Parallel Processing; Power quality; Hive;

D O I：

10.23977/iccsc.2017.1001

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

With the application of the power of big data landing and deepening, which put forward higher requirements on the performance analysis, and based on multi node parallel processing technology will become one of the core support technology and the rapid development of the application of power analysis of big data. This paper briefly analyzes the application requirements of large power parallel data processing, this paper presents a parallel processing framework for the power of big data and the realization method of management services and computing services in detail the design, research and development of parallel processing platform for the power of big data, and based on the national power quality monitoring data, comparison test Hive and 1.1.0. Compared with the experimental results, the results show that, when the node size is relatively small, the power big data parallel processing platform is less obvious than Hive 1.1.0. However, with the increasing size of the nodes, the advantages of the large data parallel processing platform of power are larger than that of Hive 1.1.0.

引用

页码：1 / 7

页数：7

共 9 条

[1]

[崔阳 Cui Yang], 2013, [测绘学报, Acta Geodetica et Cartographica Sinica], V42, P661

[2]

GU Guotai, 2009, J HENAN POLYTECHNIC, V5, P621

[3]

LI Chuan-rong, 2012, SCI TECHNOLOGY ENG, V35, P9540

[4]

[齐林海 Qi Linhai], 2014, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V34, P5493

[5]

Qu Zhijian, 2013, Proceedings of the CSEE, V33, P191

[6]

[宋亚奇 Song Yaqi], 2015, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V35, P255

[7]

Starmark Ralf, 2016, EUROPEAN J OPERATION

[8]

[王德文 Wang Dewen], 2015, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V35, P527

[9]

XIE Chen-ning, 2015, DISTRIBUTED GRAPH PA

← 1 →