Cloud Computing Model for Big Geological Data Processing

被引:4
作者
Song, Miaomiao [1 ]
Li, Zhe [1 ]
Zhou, Bin [1 ]
Li, Chaoling [2 ]
机构
[1] Shandong Acad Sci, Inst Oceanog Instrumentat, Qingdao, Peoples R China
[2] China Geol Survey, Res Dev Ctr, Beijing, Peoples R China
来源
SENSORS, MEASUREMENT AND INTELLIGENT MATERIALS II, PTS 1 AND 2 | 2014年 / 475-476卷
关键词
geological data analysis; mining area resource assessment; big data; cloud computing intelligence system; hadoop MapReduce; GPU parallel computing;
D O I
10.4028/www.scientific.net/AMM.475-476.306
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Geological data with phyletic and various, huge and complex data format, the analysis of geological data processing is mainly divided into three parts: Mines forecast, mine evaluation and mine positioning. Traditional geological data analysis model is limited by limited storage space and computational efficiency, and cannot meet the needs of a large number of geological data fast operations. "Big data technology" provides the ideal solution to the vast amounts of geological data management, information extraction, and comprehensive analysis. For mass storage capacity and high-speed computing power that the "big data technology" need, we built an intelligence systems applied to the analysis of geological data based on MapReduce and GPU double parallel processing cloud computing model. For a large number of geological data, using liadoop cluster system to solve the problem of large amounts of data storage, and designing efficient parallel processing method based on GPU (Graphics Processing Units: calculation of Graphics Processing unit), the method was applied to MapReduce framework, finally completing MapReduce and GPU double parallel processing cloud computing model to improve the operation speed of the system. Through theoretical modeling and experimental verification, indicating that the system can meet the analysis of geological data operation precision, the operation data amount and the operation speed.
引用
收藏
页码:306 / +
页数:2
相关论文
共 5 条
  • [1] Aarnio T., 2009, SEM INT
  • [2] [Anonymous], 2012, Hadoop: The definitive guide
  • [3] Mars: A MapReduce Framework on Graphics Processors
    He, Bingsheng
    Fang, Wenbin
    Luo, Qiong
    Govindaraju, Naga K.
    Wang, Tuyong
    [J]. PACT'08: PROCEEDINGS OF THE SEVENTEENTH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES, 2008, : 260 - 269
  • [4] GPU computing
    Owens, John D.
    Houston, Mike
    Luebke, David
    Green, Simon
    Stone, John E.
    Phillips, James C.
    [J]. PROCEEDINGS OF THE IEEE, 2008, 96 (05) : 879 - 899
  • [5] Pu L P, 2011, EARTH SCI, V36