The Adaptive Research of Data Layout in Large-scale Meteorological Data Storage System

被引：0
|
作者：
Jiang, Xueying [1 ]
Chen, Wenhui [1 ]
Wang, Yao [1 ]
机构：
[1] Northeastern Univ Qinhuangdao, Streaming Media Res Inst, Qinhuangdao, Hebei, Peoples R China
来源：
2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST) | 2013年
关键词：
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In the existing large-scale meteorological data storage systems, the real-time of meteorological data applications is poor; transmission of data process is opaque; meteorological data sharing is complex and self-adaptability is bad; the capability of data quality assurance is not good. For these problems, this paper presents a solution of large-scale meteorological data storage system. This paper also presents a consistent hierarchical Hash data layout algorithm. It used to solve transmission and re-layout problem in the system among meteorological data, storage devices, content transmission network and key data buffer devices. And we test this algorithm's fairness, efficiency and adaptability by experiment.
引用
收藏
页码：1016 / 1020
页数：5
相关论文
共 50 条
  • [1] Constructing a Web service system for large-scale meteorological grid data
    Amagasa, Toshiyuki
    Kitagawa, Hiroyuki
    Komano, Tatsuya
    E-SCIENCE 2007: THIRD IEEE INTERNATIONAL CONFERENCE ON E-SCIENCE AND GRID COMPUTING, PROCEEDINGS, 2007, : 118 - +
  • [2] Research on Database Storage of Large-scale Terrestrial LIDAR Data
    Guo Ming
    Wang Yanmin
    Zhao Youshan
    Zhou Junzhao
    2009 INTERNATIONAL FORUM ON COMPUTER SCIENCE-TECHNOLOGY AND APPLICATIONS, VOL 2, PROCEEDINGS, 2009, : 19 - +
  • [3] Adaptive data reduction for large-scale transaction data
    Li, Xiao-Bai
    Jacob, Varghese S.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2008, 188 (03) : 910 - 924
  • [4] Mapping algorithm for replicated data in large-scale storage system
    Mu, Fei
    Xue, Wei
    Shu, Jiwu
    Zheng, Weimin
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2009, 46 (03): : 492 - 497
  • [5] Analytical model for large-scale storage system with replicated data
    Mu, Fei
    Xue, Wei
    Shu, Jiwu
    Zheng, Weimin
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2009, 46 (05): : 756 - 761
  • [6] Static file layout strategy for large-scale storage system
    Long, S.-Q. (longsaiqin@163.com), 1600, South China University of Technology (41):
  • [7] Towards Large-Scale Meteorological Data Services: A Case Study
    Dimitar Misev
    Peter Baumann
    Jürgen Seib
    Datenbank-Spektrum, 2012, 12 (3) : 183 - 192
  • [8] Research on the Storage of Large-Scale Insulator Leakage Current Data Based on Hadoop
    Song, Yaqi
    Li, Li
    INTERNATIONAL CONFERENCE ON ELECTRONIC AND ELECTRICAL ENGINEERING (CEEE 2014), 2014, : 229 - 235
  • [9] Optimizing data robustness in large-scale storage systems
    Gougeaud, Sebastien
    Zertal, Soraya
    Lafoucriere, Jacques-Charles
    Deniel, Philippe
    2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2017, : 236 - 243
  • [10] Secure large-scale genome data storage and query
    Chen, Luyao
    Aziz, Md Momin
    Mohammed, Noman
    Jiang, Xiaoqian
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 165 : 129 - 137
12345