Representation of Spatial Data Processing Pipelines Using Relational Database

被引：0
作者：
Okladnikov I.G. [1 ,2 ]
机构：
[1] Institute of Monitoring of Climatic and Ecological Systems of the Siberian Branch of the Russian Academy of Sciences, Tomsk
[2] Federal Research Center for Information and Computational Technologies, Tomsk
来源：
Supercomputing Frontiers and Innovations | 2021年 / 8卷 / 04期
关键词：
Climate research; Databases; Directed multigraph; Information systems; Processing pipeline; Spatial data; Workflow;
D O I：
10.14529/JSFI210404
中图分类号：
学科分类号：
摘要：
A methodology for representation of spatial data processing pipelines using relational database within the framework of the computing backend of the online information-analytical system “Climate” (http://climate.scert.ru) is proposed. Each pipeline is represented by a sequence of instructions for the computing backend describing how to run data processing modules and pass datasets between them (from the output of one module to the input of another one), including raw data and final computational results obtained in graphical or binary formats. Using relational database for storing descriptions of processing pipelines used in the “Climate” system provides flexibility and efficiency while adding and developing spatial data processing modules. It also provides computing pipelines scaling for further implementation for multiprocessor systems. © The Author 2021. This paper is published with open access at SuperFri.org
引用
收藏
页码：40 / 49
页数：9
相关论文
共 12 条
  • [11] Cormen T.H., Leiserson C.E., Rivest R.L., Stein C., Introduction to Algorithms, (2009)
  • [12] Dee D.P., Uppala S.M., Simmons A.J., Et al., The ERAInterim reanalysis: Configuration and performance of the data assimilation system, Quarterly Journal of the royal meteorological society, 137, 656, pp. 553-597, (2011)
12