Mobile internet big data platform in china unicom

被引：0

作者：

机构：

[1] China Unicom Groups, Beijing 100140, No. 21 Financial Street, Xicheng District

[2] Research Institute of Information Technology (RIIT), Tsinghua National Lab for Information Science and Technology (TNList), Tsinghua University

[3] Department of Computer Science and Technology, Tsinghua University

[4] Department of Computer Science and Technology, PLA Univ. of Info. and Eng.

来源：

Chen, Z. (zhenchen@tsinghua.edu.cn) | 1600年 / Tsinghua University卷 / 19期

基金：

中国国家自然科学基金;

关键词：

3G wireless network; Big data platform; China Unicom; Data warehouse; Hadoop Distributed File System (HDFS); HBase; Mobile Internet; Network forensic;

D O I：

10.1109/tst.2014.6733212

中图分类号：

学科分类号：

摘要：

China Unicom, the largest WCDMA 3G operator in China, meets the requirements of the historical Mobile Internet Explosion, or the surging of Mobile Internet Traffic from mobile terminals. According to the internal statistics of China Unicom, mobile user traffic has increased rapidly with a Compound Annual Growth Rate (CAGR) of 135%. Currently China Unicom monthly stores more than 2 trillion records, data volume is over 525 TB, and the highest data volume has reached a peak of 5 PB. Since October 2009, China Unicom has been developing a home-brewed big data storage and analysis platform based on the open source Hadoop Distributed File System (HDFS) as it has a long-term strategy to make full use of this Big Data. All Mobile Internet Traffic is well served using this big data platform. Currently, the writing speed has reached 1 390 000 records per second, and the record retrieval time in the table that contains trillions of records is less than 100 ms. To take advantage of this opportunity to be a Big Data Operator, China Unicom has developed new functions and has multiple innovations to solve space and time constraint challenges presented in data processing. In this paper, we will introduce our big data platform in detail. Based on this big data platform, China Unicom is building an industry ecosystem based on Mobile Internet Big Data, and considers that a telecom operator centric ecosystem can be formed that is critical to reach prosperity in the modern communications business.

引用

页码：95 / 101

页数：6

共 17 条

[1]

Manyika J., Chui M., Brown B., Bughin J., Dobbs R., Roxburgh C., Byers A.H., Big data: The next frontier for innovation, Competition, and Productivity, (2011)

[2]

Meeker M., Wu L., Mary Meeker's 2013 Internet Trends Report, (2013)

[3]

Visual Networking Index: Forecast and Methodology, 2010-2015, (2011)

[4]

Li T., Han F.Y., Ding S., Chen Z., LARX: Largescale anti-phishing by retrospective data-exploring based on a cloud computing platform, Proc. 20th International Conference on Computer Communications and Networks (ICCCN), pp. 1-5, (2011)

[5]

Chen Z., Han F.Y., Cao J.W., Jiang X., Chen S., Cloud computing-based forensic analysis for collaborative network security management system, Tsinghua Science and Technology, 18, 1, pp. 40-50, (2013)

[6]

Chen Z., Ruan L.Y., Cao J.W., Yu Y., Jiang X., TIFAflow: Enhancing traffic archiving system with flow granularity for forensic analysis in network security, Tsinghua Science and Technology, 18, 4, pp. 406-417, (2013)

[7]

Kornexl S., Paxson V., Dreger H., Feldmann A., Sommer R., Building a time machine for efficient recording and retrieval of high-volume network traffic, Proc. 5th ACM SIGCOMM Conference on Internet Measurement, (2005)

[8]

Maier G., Sommer R., Dreger H., Feldmann A., Paxson V., Schneider F., Enriching network security analysis with time travel, Proc. ACM SIGCOMM 2008 Conference on Data Communication, pp. 183-194, (2008)

[9]

Li J., Ding S., Xu M., Han F.Y., Guan X., Chen Z., TIFA: Enabling real-time querying and storage of massive stream data, Proc. International Conference on Networking and Distributed Computing (ICNDC), pp. 61-64, (2011)

[10]

Wu K., Ahern S., Bethel E.W., Chen J., Childs H., Cormier-Michel E., Geddes C., Gu J., Hagen H., Hamann B., Koegler W., Lauret J., Meredith J., Messmer P., Otoo E., Perevoztchikov V., Poskanzer P.A., Rbel O., Shoshani A., Sim A., Stockinger K., Weber G., Zhang W.M., FastBit: Interactively searching massive data, Journal of Physics: Conference Series, 180, 1, (2009)

← 1 2 →