Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing

被引:47
|
作者
Wang, Yong [1 ]
Liu, Zhenling [1 ]
Liao, Hongyan [1 ]
Li, Chengjun [1 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2015年 / 18卷 / 02期
关键词
GIS; Polygon overlay processing; MapReduce; Grid index; GPC;
D O I
10.1007/s10586-015-0428-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As one of the important operations in Geographic Information System (GIS) spatial analysis, polygon overlay processing is a time-consuming task in many big data cases. In this paper, a specially designed MapReduce algorithm with grid index is proposed to decrease the running time. Our proposed algorithm can reduce the times of calling intersection computation by the aid of grid index. The experiment is carried out on the cloud framework based on Hadoop built by ourselves. Experimental results show that our algorithm with spatial grid index consumes less time than its peer without spatial index. Moreover, the proposed algorithm has an upward speed-up ratio when more nodes of Hadoop framework are used. Nevertheless, with the increase of nodes, the upward trend of speed-up ratio slows down.
引用
收藏
页码:507 / 516
页数:10
相关论文
共 50 条
  • [1] Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing
    Yong Wang
    Zhenling Liu
    Hongyan Liao
    Chengjun Li
    Cluster Computing, 2015, 18 : 507 - 516
  • [2] A MapReduce-Based Big Spatial Data Framework for Solving the Problem of Covering a Polygon with Orthogonal Rectangles
    Eken, Suleyman
    Sayar, Ahmet
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2019, 26 (01): : 36 - 42
  • [3] The Performance Optimization of Big Data Processing by Adaptive MapReduce Workflow
    Li, Wei
    Tang, Maolin
    IEEE ACCESS, 2022, 10 : 79004 - 79020
  • [4] Spatial Data Processing with MapReduce
    Gunawardena, Tilani
    Vicari, Annamaria
    Mecca, Giansalvatore
    2015 IEEE 10TH INTERNATIONAL CONFERENCE ON INDUSTRIAL AND INFORMATION SYSTEMS (ICIIS), 2015, : 485 - 490
  • [5] Prominence of MapReduce in BIG DATA Processing
    Pandey, Shweta
    Tokekar, Vrinda
    2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, : 555 - 560
  • [6] High-Performance Geospatial Big Data Processing System Based on MapReduce
    Jo, Junghee
    Lee, Kang-Woo
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (10):
  • [7] Data Preloading and Data Placement for MapReduce Performance Improving
    Spivak, Anton
    Nasonov, Denis
    5TH INTERNATIONAL YOUNG SCIENTIST CONFERENCE ON COMPUTATIONAL SCIENCE, YSC 2016, 2016, 101 : 379 - 387
  • [9] Verifying Properties of MapReduce-Based Big Data Processing
    Zhang, Nan
    Wang, Meng
    Duan, Zhenhua
    Tian, Cong
    IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) : 321 - 338
  • [10] Big Data Processing with Probabilistic Latent Semantic Analysis on MapReduce
    Zhao, Yong
    Chen, Yao
    Liang, Zhao
    Yuan, Shuangshuang
    Li, Youfu
    2014 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC), 2014, : 162 - 166