Representation of Spatial Data Processing Pipelines Using Relational Database

被引：0
作者：
Okladnikov I.G. [1 ,2 ]
机构：
[1] Institute of Monitoring of Climatic and Ecological Systems of the Siberian Branch of the Russian Academy of Sciences, Tomsk
[2] Federal Research Center for Information and Computational Technologies, Tomsk
来源：
Supercomputing Frontiers and Innovations | 2021年 / 8卷 / 04期
关键词：
Climate research; Databases; Directed multigraph; Information systems; Processing pipeline; Spatial data; Workflow;
D O I：
10.14529/JSFI210404
中图分类号：
学科分类号：
摘要：
A methodology for representation of spatial data processing pipelines using relational database within the framework of the computing backend of the online information-analytical system “Climate” (http://climate.scert.ru) is proposed. Each pipeline is represented by a sequence of instructions for the computing backend describing how to run data processing modules and pass datasets between them (from the output of one module to the input of another one), including raw data and final computational results obtained in graphical or binary formats. Using relational database for storing descriptions of processing pipelines used in the “Climate” system provides flexibility and efficiency while adding and developing spatial data processing modules. It also provides computing pipelines scaling for further implementation for multiprocessor systems. © The Author 2021. This paper is published with open access at SuperFri.org
引用
收藏
页码：40 / 49
页数：9
相关论文
共 12 条
  • [1] Gordov E., Shiklomanov A., Okladnikov I., Et al., Development of Distributed Research Center for analysis of regional climatic and environmental changes, IOP Conference Series: Earth and Environmental Science, 48, (2016)
  • [2] Okladnikov I.G., Gordov E.P., Titov A.G., Development of climate data storage and processing model, IOP Conference Series: Earth and Environmental Science, 48, (2016)
  • [3] Okladnikov I.G., Computing core of a software package for “cloud” analysis of climate change and the environment, IOP Conference Series: Earth and Environmental Science, 611, (2020)
  • [4] Swamy M.N.S., Thulasiraman K., Graphs, Networks, and Algorithms, (1980)
  • [5] Allamanis M., Brockschmidt M., Khademi M., Learning to represent programs with graphs, International Conference on Learning Representations (ICLR), (2018)
  • [6] Chang C.L., Interpretation and execution of fuzzy programs, Fuzzy Sets and Their Applications to Cognitive and Decision Process, pp. 191-218, (1975)
  • [7] Averkin A.N., Batyrshin I.Z., Blishun A.F., Et al., Fuzzy sets in models of control and artificial intelligence, (1986)
  • [8] Li Yu., Tarlow D., Brockschmidt M., Zemel R., Gated graph sequence neural networks, International Conference on Learning Representations (ICLR), (2015)
  • [9] Balakrishnan V.K., Graph Theory, (1997)
  • [10] Halpin T., Entity Relationship modeling from an ORM perspective: Part 1, Object Role Modeling
12