Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing

被引:47
作者
Wang, Yong [1 ]
Liu, Zhenling [1 ]
Liao, Hongyan [1 ]
Li, Chengjun [1 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2015年 / 18卷 / 02期
关键词
GIS; Polygon overlay processing; MapReduce; Grid index; GPC;
D O I
10.1007/s10586-015-0428-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As one of the important operations in Geographic Information System (GIS) spatial analysis, polygon overlay processing is a time-consuming task in many big data cases. In this paper, a specially designed MapReduce algorithm with grid index is proposed to decrease the running time. Our proposed algorithm can reduce the times of calling intersection computation by the aid of grid index. The experiment is carried out on the cloud framework based on Hadoop built by ourselves. Experimental results show that our algorithm with spatial grid index consumes less time than its peer without spatial index. Moreover, the proposed algorithm has an upward speed-up ratio when more nodes of Hadoop framework are used. Nevertheless, with the increase of nodes, the upward trend of speed-up ratio slows down.
引用
收藏
页码:507 / 516
页数:10
相关论文
共 50 条
  • [11] Performance Evaluation of Big Data Frameworks: MapReduce and Spark
    Singh, Jaspreet
    Panda, S. N.
    Kaushal, Rajesh
    INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 : 1611 - 1619
  • [12] An Implementation Approach of Big Data Computation by Mapping Java']Java Classes to MapReduce
    Verma, Chitresh
    Pandey, Rajiv
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 282 - 287
  • [13] Improving Mapreduce for Incremental Processing Using Map Data Storage
    Anandkrishna, R.
    Kumar, Dhananjay
    FOURTH INTERNATIONAL CONFERENCE ON RECENT TRENDS IN COMPUTER SCIENCE & ENGINEERING (ICRTCSE 2016), 2016, 87 : 288 - 293
  • [14] Trust-Based Scheduling Framework for Big Data Processing with MapReduce
    Thanh Dat Dang
    Doan Hoang
    Nguyen, Diep N.
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (01) : 279 - 293
  • [15] Code Refactoring from OpenMP to MapReduce Model for Big Data Processing
    Zhao, Junfeng
    Zhang, Minjia
    Yang, Hongji
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 930 - 935
  • [16] Multi-objective scheduling of MapReduce jobs in big data processing
    Ibrahim Abaker Targio Hashem
    Nor Badrul Anuar
    Mohsen Marjani
    Abdullah Gani
    Arun Kumar Sangaiah
    Adewole Kayode Sakariyah
    Multimedia Tools and Applications, 2018, 77 : 9979 - 9994
  • [17] MapReduce Based Scalable Range Query Architecture for Big Spatial Data
    Kizgindere, Umut
    Eken, Suleyman
    Sayar, Ahmet
    2015 IEEE/ACS 12TH INTERNATIONAL CONFERENCE OF COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2015,
  • [18] A Survey on Geographically Distributed Big-Data Processing Using MapReduce
    Dolev, Shlomi
    Florissi, Patricia
    Gudes, Ehud
    Sharma, Shantanu
    Singer, Ido
    IEEE TRANSACTIONS ON BIG DATA, 2019, 5 (01) : 60 - 80
  • [19] An Approach to Enhance the Performance of Hadoop MapReduce Framework for Big Data
    Chandra, Subhash
    Motwani, Deepak
    2016 INTERNATIONAL CONFERENCE ON MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING (ICMETE), 2016, : 178 - 182
  • [20] MapReduce Based Scalable Range Query Architecture for Big Spatial Data
    Eken, Suleyman
    Kizgindere, Umut
    Sayar, Ahmet
    RISE OF BIG SPATIAL DATA, 2017, : 263 - 272