Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing

被引:48
作者
Wang, Yong [1 ]
Liu, Zhenling [1 ]
Liao, Hongyan [1 ]
Li, Chengjun [1 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2015年 / 18卷 / 02期
关键词
GIS; Polygon overlay processing; MapReduce; Grid index; GPC;
D O I
10.1007/s10586-015-0428-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As one of the important operations in Geographic Information System (GIS) spatial analysis, polygon overlay processing is a time-consuming task in many big data cases. In this paper, a specially designed MapReduce algorithm with grid index is proposed to decrease the running time. Our proposed algorithm can reduce the times of calling intersection computation by the aid of grid index. The experiment is carried out on the cloud framework based on Hadoop built by ourselves. Experimental results show that our algorithm with spatial grid index consumes less time than its peer without spatial index. Moreover, the proposed algorithm has an upward speed-up ratio when more nodes of Hadoop framework are used. Nevertheless, with the increase of nodes, the upward trend of speed-up ratio slows down.
引用
收藏
页码:507 / 516
页数:10
相关论文
共 50 条
[11]   Verifying Properties of MapReduce-Based Big Data Processing [J].
Zhang, Nan ;
Wang, Meng ;
Duan, Zhenhua ;
Tian, Cong .
IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) :321-338
[12]   Performance Evaluation of Big Data Frameworks: MapReduce and Spark [J].
Singh, Jaspreet ;
Panda, S. N. ;
Kaushal, Rajesh .
INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 :1611-1619
[13]   An Implementation Approach of Big Data Computation by Mapping Java']Java Classes to MapReduce [J].
Verma, Chitresh ;
Pandey, Rajiv .
PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, :282-287
[14]   Improving Mapreduce for Incremental Processing Using Map Data Storage [J].
Anandkrishna, R. ;
Kumar, Dhananjay .
FOURTH INTERNATIONAL CONFERENCE ON RECENT TRENDS IN COMPUTER SCIENCE & ENGINEERING (ICRTCSE 2016), 2016, 87 :288-293
[15]   MapReduce Based Scalable Range Query Architecture for Big Spatial Data [J].
Eken, Suleyman ;
Kizgindere, Umut ;
Sayar, Ahmet .
RISE OF BIG SPATIAL DATA, 2017, :263-272
[16]   Trust-Based Scheduling Framework for Big Data Processing with MapReduce [J].
Thanh Dat Dang ;
Doan Hoang ;
Nguyen, Diep N. .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (01) :279-293
[17]   Multi-objective scheduling of MapReduce jobs in big data processing [J].
Hashem, Ibrahim Abaker Targio ;
Anuar, Nor Badrul ;
Marjani, Mohsen ;
Gani, Abdullah ;
Sangaiah, Arun Kumar ;
Sakariyah, Adewole Kayode .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (08) :9979-9994
[18]   Code Refactoring from OpenMP to MapReduce Model for Big Data Processing [J].
Zhao, Junfeng ;
Zhang, Minjia ;
Yang, Hongji .
2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, :930-935
[19]   Multi-objective scheduling of MapReduce jobs in big data processing [J].
Ibrahim Abaker Targio Hashem ;
Nor Badrul Anuar ;
Mohsen Marjani ;
Abdullah Gani ;
Arun Kumar Sangaiah ;
Adewole Kayode Sakariyah .
Multimedia Tools and Applications, 2018, 77 :9979-9994
[20]   MapReduce Based Scalable Range Query Architecture for Big Spatial Data [J].
Kizgindere, Umut ;
Eken, Suleyman ;
Sayar, Ahmet .
2015 IEEE/ACS 12TH INTERNATIONAL CONFERENCE OF COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2015,