The Adaptive Research of Data Layout in Large-scale Meteorological Data Storage System

被引：0

作者：

Jiang, Xueying ^{[1
]}

Chen, Wenhui ^{[1
]}

Wang, Yao ^{[1
]}

机构：

[1] Northeastern Univ Qinhuangdao, Streaming Media Res Inst, Qinhuangdao, Hebei, Peoples R China

来源：

2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST) | 2013年

关键词：

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In the existing large-scale meteorological data storage systems, the real-time of meteorological data applications is poor; transmission of data process is opaque; meteorological data sharing is complex and self-adaptability is bad; the capability of data quality assurance is not good. For these problems, this paper presents a solution of large-scale meteorological data storage system. This paper also presents a consistent hierarchical Hash data layout algorithm. It used to solve transmission and re-layout problem in the system among meteorological data, storage devices, content transmission network and key data buffer devices. And we test this algorithm's fairness, efficiency and adaptability by experiment.

引用

页码：1016 / 1020

页数：5

共 50 条

[41] A Data Analysis and Visualization System for Large-Scale e-Bike Data [J].

Jia, Xiaoxia ;

Cheng, Feng ;

Chen, Jiming .

2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, :3998-4000

[42] Client-centric consistency formalization and verification for system with large-scale distributed data storage [J].

Zhu, Yuqing ;

Wang, Jianmin .

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2010, 26 (08) :1180-1188

[43] Big Data Analysis and Visualization System for Large-scale Pumped Storage Power Station Equipment [J].

Gong, Yu ;

Liu, Xuan ;

Yang, Mingxuan ;

Wu, Hao .

2024 THE 9TH INTERNATIONAL CONFERENCE ON POWER AND RENEWABLE ENERGY, ICPRE, 2024, :1526-1532

[44] Generating Large-Scale Longitudinal Data Resources for Aging Research [J].

Gallacher, John ;

Hofer, Scott M. .

JOURNALS OF GERONTOLOGY SERIES B-PSYCHOLOGICAL SCIENCES AND SOCIAL SCIENCES, 2011, 66 :172-179

[45] Efficient data management in a large-scale epidemiology research project [J].

Meyer, Jens ;

Ostrzinski, Stefan ;

Fredrich, Daniel ;

Havemann, Christoph ;

Krafczyk, Janina ;

Hoffmann, Wolfgang .

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2012, 107 (03) :425-435

[46] iLCM - A Virtual Research Infrastructure for Large-Scale Qualitative Data [J].

Niekler, Andreas ;

Bleier, Arnim ;

Kahmann, Christian ;

Posch, Lisa ;

Wiedemann, Gregor ;

Erdogan, Kenan ;

Heyer, Gerhard ;

Strohmaier, Markus .

PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, :1313-1319

[47] Large-scale population data enrichment in mental health research [J].

Nees, Frauke ;

Renne, Paul ;

Holz, Nathalie E. ;

Polemlti, Elli ;

Siehl, Sebastian ;

Hese, Soeren ;

Schepanski, Kerstin ;

Schumann, Gunter ;

environMENTAL consortium .

NATURE MENTAL HEALTH, 2024, 2 (10) :1124-1127

[48] Diverse and large-scale brain data in child development research [J].

Zhang, Liang ;

Xue, Gui .

NATURE HUMAN BEHAVIOUR, 2025, 9 (06) :1070-1072

[49] Marbor: A Novel Large-Scale Graph Data Storage and Processing Framework [J].

Zhou, Wei ;

Gao, Yun ;

Han, Jizhong ;

Xu, Zhiyong .

2014 IEEE INTERNATIONAL PERFORMANCE COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC), 2014,

[50] Large-scale electrophysiology: Acquisition, compression, encryption, and storage of big data [J].

Brinkmann, Benjamin H. ;

Bower, Mark R. ;

Stengel, Keith A. ;

Worrell, Gregory A. ;

Stead, Matt .

JOURNAL OF NEUROSCIENCE METHODS, 2009, 180 (01) :185-192

← 1 2 3 4 5 →