Telecom data processing and analysis based on hadoop

被引:0
|
作者
机构
[1] Lu, Guofan
[2] Zhang, Qingnian
[3] Chen, Zhao
来源
Zhang, Qingnian | 1600年 / Transport and Telecommunication Institute, Lomonosova street 1, Riga, LV-1019, Latvia卷 / 18期
关键词
Competition - Data handling;
D O I
暂无
中图分类号
学科分类号
摘要
For call tracking system to adapt to the needs of large data processing, combined with a strong competitive advantage in recent years in large data processing Hadoop platform, designed and implemented a Hadoop-based call tracking data processing model, in order to verify its feasibility. The call tracking processing system model contains an analog data source module, data processing module, and a GUI interface. Analog data source module from real data samples in the simulated data, and the data is written directly to the Hadoop distributed file system, then using Hadoop's MapReduce model to write appropriate Mapper and Reducer function, the distributed processing of the data. Detailed study based on the system design and implementation, system deployment topology, hardware and software conditions, and designed several comparative experiments to analyze some static indicators of system performance.
引用
收藏
相关论文
共 50 条
  • [31] Association Analysis of Large Sample Data Based on Hadoop
    An, Ran
    Pan, Jingchang
    PROCEEDINGS OF THE 2015 INTERNATIONAL INDUSTRIAL INFORMATICS AND COMPUTER ENGINEERING CONFERENCE, 2015, : 1255 - 1258
  • [32] PDM: A parallel data analysis system based on Hadoop
    Duan, Song-Qing
    Wu, Bin
    Yu, Le
    Wang, Bai
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2012, 39 (10): : 87 - 92
  • [33] Efficient Big Data Processing in Hadoop MapReduce
    Dittrich, Jens
    Quiane-Ruiz, Jorge-Arnulfo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (12): : 2014 - 2015
  • [34] Online Data Processing on Cloud and Hadoop Platform
    Akhtar, Ayesha
    Shakir, Muhammad Sohaib
    2017 FOURTH HCT INFORMATION TECHNOLOGY TRENDS (ITT), 2017, : 25 - 29
  • [35] HadoopTrajectory: a Hadoop spatiotemporal data processing extension
    Bakli, Mohamed
    Sakr, Mahmoud
    Soliman, Taysir Hassan A.
    JOURNAL OF GEOGRAPHICAL SYSTEMS, 2019, 21 (02) : 211 - 235
  • [36] Scientific data processing framework for Hadoop MapReduce
    Department of Computer and Information, Xinxiang University, Xinxiang, China
    1600, Journal of Chemical and Pharmaceutical Research, 3/668 Malviya Nagar, Jaipur, Rajasthan, India (06):
  • [37] HadoopTrajectory: a Hadoop spatiotemporal data processing extension
    Mohamed Bakli
    Mahmoud Sakr
    Taysir Hassan A. Soliman
    Journal of Geographical Systems, 2019, 21 : 211 - 235
  • [38] Architecture of Geospatial Big-Data Batch Processing Model Based on Hadoop
    Kim, Sang-Su
    Yu, Sung-Hwan
    2015 INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC), 2015, : 964 - 966
  • [39] Hadoop-based Distributed Computing Algorithms for Healthcare and Clinic Data Processing
    Ni, Jun
    Chen, Ying
    Sha, Jie
    Zhang, Minghuan
    2015 EIGHTH INTERNATIONAL CONFERENCE ON INTERNET COMPUTING FOR SCIENCE AND ENGINEERING (ICICSE), 2015, : 188 - 193
  • [40] A Hadoop Processing Method for Massive Sensor Network Data Based on Internet of Things
    Yanxin Zhang
    International Journal of Wireless Information Networks, 2020, 27 : 299 - 306