ScienceEarth: A Big Data Platform for Remote Sensing Data Processing

被引:37
|
作者
Xu, Chen [1 ]
Du, Xiaoping [1 ]
Yan, Zhenzhen [1 ]
Fan, Xiangtao [1 ]
机构
[1] Chinese Acad Sci, Inst Remote Sensing & Digital Earth, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
big data; remote sensing data processing; distributed file system; HBase; Spark;
D O I
10.3390/rs12040607
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Mass remote sensing data management and processing is currently one of the most important topics. In this study, we introduce ScienceEarth, a cluster-based data processing framework. The aim of ScienceEarth is to store, manage, and process large-scale remote sensing data in a cloud-based cluster-computing environment. The platform consists of the following three main parts: ScienceGeoData, ScienceGeoIndex, and ScienceGeoSpark. ScienceGeoData stores and manages remote sensing data. ScienceGeoIndex is an index and query system, a spatial index based on quad-tree and Hilbert curve which is combined for heterogeneous tiled remote sensing data that makes efficient data retrieval in ScienceGeoData. ScienceGeoSpark is an easy-to-use computing framework in which we use Apache Spark as the analytics engine for big remote sensing data processing. The result of tests proves that ScienceEarth can efficiently store, retrieve, and process remote sensing data. The results reveal ScienceEarth has the potential and capabilities of efficient big remote sensing data processing.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Processing and Classification of Multichannel Remote Sensing Data
    Lukin, Vladimir
    Ponomarenko, Nikolay
    Kurekin, Andrey
    Pogrebnyak, Oleksiy
    ADVANCES IN SOFT COMPUTING, PT II, 2011, 7095 : 487 - +
  • [32] Software for earth remote sensing data processing
    Asmus, VV
    Buchnev, AA
    Pyatkin, VP
    Proceedings of the Second IASTED International Multi-Conference on Automation, Control, and Information Technology - Signal and Image Processing, 2005, : 1 - 4
  • [33] MACHINE LEARNING IN REMOTE SENSING DATA PROCESSING
    Camps-Valls, Gustavo
    2009 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2009, : 216 - 221
  • [34] Remote Sensing Big Data: Theory, Methods and Applications
    Liu, Peng
    Di, Liping
    Du, Qian
    Wang, Lizhe
    REMOTE SENSING, 2018, 10 (05):
  • [35] Automatic analysis and mining of remote sensing big data
    State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan
    430079, China
    不详
    430079, China
    Cehui Xuebao, 12 (1211-1216):
  • [36] Foreword to the Special Issue on Big Data in Remote Sensing
    Chi, Mingmin
    Plaza, Antonio J.
    Benediktsson, Jon Atli
    Zhang, Bing
    Huang, Bormin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (10) : 4607 - 4609
  • [37] Remote sensing big data computing: Challenges and opportunities
    Ma, Yan
    Wu, Haiping
    Wang, Lizhe
    Huang, Bormin
    Ranjan, Rajiv
    Zomaya, Albert
    Jie, Wei
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2015, 51 : 47 - 60
  • [38] Agricultural remote sensing big data:Management and applications
    Yanbo Huang
    CHEN Zhong-xin
    YU Tao
    HUANG Xiang-zhi
    GU Xing-fa
    Journal of Integrative Agriculture, 2018, 17 (09) : 1915 - 1931
  • [39] Agricultural remote sensing big data: Management and applications
    Huang, Yanbo
    Chen Zhong-xin
    Yu Tao
    Huang Xiang-zhi
    Gu Xing-fa
    JOURNAL OF INTEGRATIVE AGRICULTURE, 2018, 17 (09) : 1915 - 1931
  • [40] SCALABLE DEVELOPMENTS FOR BIG DATA ANALYTICS IN REMOTE SENSING
    Cavallaro, G.
    Riedel, M.
    Bodenstein, C.
    Glock, P.
    Richerzhagen, M.
    Goetz, M.
    Benediktsson, J. A.
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 1366 - 1369