Big Data Approach to Fluid Dynamics Visualization Problem

被引：0

作者：

Reshetnikov, Vyacheslav ^{[1
]}

Golubchikov, Egor ^{[1
]}

Pyatlin, Andrey ^{[1
]}

Kuzin, Alexey ^{[1
]}

Kiev, Vladislav ^{[1
]}

Shabrov, Nikolay ^{[1
]}

Zhuravlev, Alexey ^{[1
,2
]}

Guseva, Ekaterina ^{[1
]}

机构：

[1] Peter Great St Petersburg Polytech Univ, St Petersburg, Russia

[2] Reutlingen Univ, Reutlingen, Germany

来源：

COMPUTATIONAL SCIENCE - ICCS 2019, PT V | 2019年 / 11540卷

基金：

俄罗斯科学基金会;

关键词：

Visualization; Spark; ParaView; Parquet;

D O I：

10.1007/978-3-030-22750-0_38

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Present work is dedicated to development of the software for interactive visualization of results of simulation of gas dynamics problems on meshes of extra large sizes. Kitware ParaView visualization tool, which is popular among engineers and scientists is used as a frontend. The coupling of client and server instances of ParaView is used in the project. The crucial feature of the work is an application of Apache Hadoop and Apache Spark for distributed retrieving of simulation data from files on hard disk. The data is stored on the cluster in Hadoop Distributed File System (HDFS) managed by Apache Hadoop and is provided to ParaView server by Apache Spark data processing tool.

引用

页码：461 / 467

页数：7

共 12 条

[1] Scientific big data visualization: A coupled tools approach [J].

Artigues, Antoni ;

Cucchietti, Fernando M. ;

Montes, Carlos Tripiana ;

Vicente, David ;

Calmet, Hadrien ;

Marín, Guillermo ;

Houzeaux, Guillaume ;

Vazquez, Mariano .

Supercomputing Frontiers and Innovations, 2014, 1 (03) :4-18

[2]

Belyaev S., 2018, IADIS INT C INT HUM, P377

[3]

Belyaev Sergey, 2018, [Journal of Electronic Science and Technology, 电子科技学刊(英文版)], V16, P222

[4]

Childs H, 2005, IEEE VISUALIZATION 2005, PROCEEDINGS, P191

[5] Significance and Challenges of Big Data Research [J].

Jin, Xiaolong ;

Wah, Benjamin W. ;

Cheng, Xueqi ;

Wang, Yuanzhuo .

BIG DATA RESEARCH, 2015, 2 (02) :59-64

[6]

Lange B., 2014, HADOOP DISTRIBUTION

[7] Dremel: Interactive Analysis of Web-Scale Datasets [J].

Melnik, Sergey ;

Gubarev, Andrey ;

Long, Jing Jing ;

Romer, Geoffrey ;

Shivakumar, Shiva ;

Tolton, Matt ;

Vassilakis, Theo .

COMMUNICATIONS OF THE ACM, 2011, 54 (06) :114-123

[8]

Mitchell C, 2011, CONTEXTS LEARN, P69

[9] Two-pass real-time direct isosurface rendering algorithm optimization for HTC Vive and low performance devices. [J].

Savchuk, Daniil A. ;

Belyaev, Sergey Y. .

MEDICAL IMAGING 2018: IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS, 2018, 10579

[10]

Voinov N, 2017, PROC CONF OPEN INNOV, P491, DOI 10.23919/FRUCT.2017.8071353

← 1 2 →