Design and application research on data service platform for big data

被引:0
作者
Liu, Yun-Feng [1 ]
Li, Li [1 ]
Wang, Su-Mei [1 ]
Wang, Qian-Yi [1 ]
Yang, Xu [1 ]
Ouyang, Rong-Bin [1 ]
Long, Xin-Zheng [1 ]
机构
[1] Computer Center, Peking University
来源
Tongxin Xuebao/Journal on Communications | 2013年 / 34卷 / SUPPL.2期
关键词
Big data; Data model; Data service center; MapReduce;
D O I
10.3969/j.issn.1000-436x.2013.z2.032
中图分类号
学科分类号
摘要
Big data management gives challenges to data manage and service platform based on traditional relational database management system, and research on big data management and service platform supporting both structured and unstructured data has become a very urgent and important task. 4 key technologies for big data management service platform was summarized, and the configurable generalization table model was adopt. The data service center system prototype BIG-DMS based on Hadoop platform and the application scheme of data integration services platform based on BIG-DMS were also designed to support both structured and unstructured data storage, management and access services.
引用
收藏
页码:170 / 174
页数:4
相关论文
共 10 条
  • [1] (2011)
  • [2] Zhou X.F., Lu J.H., Li C.P., Et al., The challenges of big data from the perspective of data management, Communications of the China Computer Federation, 8, 9, pp. 16-21, (2012)
  • [3] Peking university electronic affairs information portal project, (2006)
  • [4] Wang Q.Y., Li L., Ouyang R.B., Et al., Discussion on infrastructure proposal of data integration and service platform, Experimental Technology and Management, 28, 5, pp. 4-6, (2011)
  • [5] Long X.Z., Ouyang R.B., Wang Q.Y., Et al., Design and implementation of a comprehensive query system based on SSI model, Journey of Wuhan University (Natural Science Edition), 58, 21, pp. 242-246, (2012)
  • [6] Cheng X., Meng B.P., Chen Y.X., Et al., Dynamic table: A layered and configurable storage structure in the cloud, WAIM Workshops, pp. 204-215, (2012)
  • [7] (2011)
  • [8] Dean J., Ghemawat S., MapReduce: Simplified data processing on large clusters, Proc of the OSDI, pp. 137-150, (2004)
  • [9] Ousterhout J., Agrawal P., Erickson D., Et al., The case for ramcloud, Communications of the ACM, 54, 7, pp. 121-130, (2011)
  • [10] Zaharia M., Chowdhury M., Das T., Et al., Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing, Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, pp. 1-14, (2012)