The Possibilities of Big GIS Data Processing on the Desktop Computers

被引:0
作者
Bartonek, Dalibor [1 ,2 ]
机构
[1] Brno Univ Technol, Inst Geodesy, Fac Civil Engn, Veveri 330-95, Brno 60200, Czech Republic
[2] European Polytech Inst, Osvobozeni 899, Kunovice 68604, Czech Republic
来源
RISE OF BIG SPATIAL DATA | 2017年
关键词
Big data; GIS; Optimization; Desktop computer;
D O I
10.1007/978-3-319-45123-7_20
中图分类号
P9 [自然地理学]; K9 [地理];
学科分类号
0705 ; 070501 ;
摘要
The paper submits the method how to solve big projects in the sphere of geographic information systems (GIS). Our aim is to answer the question whether we can or cannot solve similar projects on commonly used hardware and software. This method is based on making use of parallelism and optimization of individual processes. The whole GIS project is divided according to the territory principle into the individual projects which can be processed concurrently. In the frame of sub-projects data optimization of main theme is performed. After the finishing of the particular phases of the project a manual check of partial results follows. The final step consists in completing the separate results into common database. The project was solved for the GasNet, Ltd. Company which is a part of a RWE group in the Czech Republic. Input data were datasets of orthophoto with a resolution of 25 cm/pixel, layers of communications of ZABAGED CR and vector sets of the route of line of underground engineering networks. Due to the territorial coverage of the CR with the area of 64,350 km(2), these were massive tasks with total data volume more than 500 GB. The data analysis was carried out in the special created application in Python language with the support of ESRI libraries and also in ArcGIS 10.0 environment.
引用
收藏
页码:273 / 287
页数:15
相关论文
共 50 条
  • [1] Big data GIS
    Li, Q. (liqq@szu.edu.cn), 1600, Editorial Board of Medical Journal of Wuhan University (39): : 641 - 644+666
  • [2] Using Data Variety for Efficient Progressive Big Data Processing in Warehouse-Scale Computers
    Ahmadvand, Hossein
    Goudarzi, Maziar
    IEEE COMPUTER ARCHITECTURE LETTERS, 2017, 16 (02) : 166 - 169
  • [3] Big Data Processing on Single Board Computer Clusters: Exploring Challenges and Possibilities
    Lee, Eunseo
    Oh, Hyunju
    Park, Dongchul
    IEEE ACCESS, 2021, 9 : 142551 - 142565
  • [4] GIS, BIG DATA AND MAPPING IN DISASTER MANAGEMENT
    Sylka, Milaim
    8TH INTERNATIONAL CONFERENCE ON CARTOGRAPHY AND GIS, VOL. 1, 2020, : 535 - 544
  • [5] GIS, Big Data, and a Tweet Corpus Operationalized via Natural Language Processing
    Corso, Anthony J.
    Alsudais, Kareem
    AMCIS 2015 PROCEEDINGS, 2015,
  • [6] GIS in the Era of Big Data
    Goodchild, Michael F.
    CYBERGEO-EUROPEAN JOURNAL OF GEOGRAPHY, 2016,
  • [7] Agile Elastic Desktop Corporate Architecture for Big Data
    Kisimov, Valentin
    Kabakchieva, Dorina
    Naydenov, Aleksandar
    Stefanova, Kamelia
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2020, 20 (03) : 15 - 31
  • [8] COVID-19: Challenges to GIS with Big Data
    Zhou, Chenghu
    Su, Fenzhen
    Pei, Tao
    Zhang, An
    Du, Yunyan
    Luo, Bin
    Cao, Zhidong
    Wang, Juanle
    Yuan, Wen
    Zhu, Yunqiang
    Song, Ci
    Chen, Jie
    Xu, Jun
    Li, Fujia
    Ma, Ting
    Jiang, Lili
    Yan, Fengqin
    Yi, Jiawei
    Hu, Yunfeng
    Liao, Yilan
    Xiao, Han
    GEOGRAPHY AND SUSTAINABILITY, 2020, 1 (01) : 77 - 87
  • [9] Big Social Data and GIS: Visualize Predictive Crime
    Corso, Anthony J.
    Alsudais, Abdulkareem
    Hilton, Brian
    AMCIS 2016 PROCEEDINGS, 2016,
  • [10] Maps & GIS Data Libraries in the Era of Big Data and Cloud Computing
    Goldberg, Daniel
    Olivares, Miriam
    Li, Zhongxia
    Klein, Andrew G.
    JOURNAL OF MAP & GEOGRAPHY LIBRARIES, 2014, 10 (01) : 100 - 122