Telecom data processing and analysis based on hadoop

被引:0
|
作者
机构
[1] Lu, Guofan
[2] Zhang, Qingnian
[3] Chen, Zhao
来源
Zhang, Qingnian | 1600年 / Transport and Telecommunication Institute, Lomonosova street 1, Riga, LV-1019, Latvia卷 / 18期
关键词
Competition - Data handling;
D O I
暂无
中图分类号
学科分类号
摘要
For call tracking system to adapt to the needs of large data processing, combined with a strong competitive advantage in recent years in large data processing Hadoop platform, designed and implemented a Hadoop-based call tracking data processing model, in order to verify its feasibility. The call tracking processing system model contains an analog data source module, data processing module, and a GUI interface. Analog data source module from real data samples in the simulated data, and the data is written directly to the Hadoop distributed file system, then using Hadoop's MapReduce model to write appropriate Mapper and Reducer function, the distributed processing of the data. Detailed study based on the system design and implementation, system deployment topology, hardware and software conditions, and designed several comparative experiments to analyze some static indicators of system performance.
引用
收藏
相关论文
共 50 条
  • [21] Performance Modeling and Analysis of a Hadoop Cluster for Efficient Big Data Processing
    Lim, JongBeom
    Ahnh, Jong-Suk
    Lee, Kang-Woo
    ADVANCED SCIENCE LETTERS, 2016, 22 (09) : 2314 - 2319
  • [22] Design and Development of a Medical Big Data Processing System Based on Hadoop
    Yao, Qin
    Tian, Yu
    Li, Peng-Fei
    Tian, Li-Li
    Qian, Yang-Ming
    Li, Jing-Song
    JOURNAL OF MEDICAL SYSTEMS, 2015, 39 (03)
  • [23] A Sensor Data Processing and Access Platform based on Hadoop for Smart Environments
    Lin, Chi-Yi
    Li, Chia-Chen
    Huang, Wei-Hsun
    Liao, Wei-Che
    Chen, Wei-Ming
    2014 17TH INTERNATIONAL CONFERENCE ON NETWORK-BASED INFORMATION SYSTEMS (NBIS 2014), 2014, : 453 - 458
  • [24] Data processing of hadoop-based wide area measurement system
    Zhu, L. (Zhulizb@sina.com), 1600, Automation of Electric Power Systems Press (37):
  • [25] Design and Development of a Medical Big Data Processing System Based on Hadoop
    Qin Yao
    Yu Tian
    Peng-Fei Li
    Li-Li Tian
    Yang-Ming Qian
    Jing-Song Li
    Journal of Medical Systems, 2015, 39
  • [26] A Data Processing Framework for Cloud Environment Based on Hadoop and Grid Middleware
    Kim, Hyukho
    Kim, Woongsup
    Lee, Kyoungmook
    Kim, Yangwoo
    GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 515 - +
  • [27] Hadoop and Spark for Data Management, Processing and Analysis of Astronomical Big Data: Applicability and Performance
    Harischandra, Lloyd
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXV, 2017, 512 : 41 - 44
  • [28] Mass Log Data Processing and Mining Based on Hadoop and Cloud Computing
    Yu, Hongyong
    Wang, Deshuai
    PROCEEDINGS OF 2012 7TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, VOLS I-VI, 2012, : 197 - 202
  • [29] A distributed data processing scheme based on Hadoop for synchrotron radiation experiments
    Zhang, Ding
    Dai, Ze-Yi
    Sun, Xue-Ping
    Wu, Xue-Ting
    Li, Hui
    Tang, Lin
    He, Jian-Hua
    JOURNAL OF SYNCHROTRON RADIATION, 2024, 31 : 635 - 645
  • [30] Correction to: A system based on Hadoop for radar data analysis
    Chi Yang
    Xiaomin Yang
    Feng Yang
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 : 14365 - 14365