Telecom data processing and analysis based on hadoop

被引:0
|
作者
机构
[1] Lu, Guofan
[2] Zhang, Qingnian
[3] Chen, Zhao
来源
Zhang, Qingnian | 1600年 / Transport and Telecommunication Institute, Lomonosova street 1, Riga, LV-1019, Latvia卷 / 18期
关键词
Competition - Data handling;
D O I
暂无
中图分类号
学科分类号
摘要
For call tracking system to adapt to the needs of large data processing, combined with a strong competitive advantage in recent years in large data processing Hadoop platform, designed and implemented a Hadoop-based call tracking data processing model, in order to verify its feasibility. The call tracking processing system model contains an analog data source module, data processing module, and a GUI interface. Analog data source module from real data samples in the simulated data, and the data is written directly to the Hadoop distributed file system, then using Hadoop's MapReduce model to write appropriate Mapper and Reducer function, the distributed processing of the data. Detailed study based on the system design and implementation, system deployment topology, hardware and software conditions, and designed several comparative experiments to analyze some static indicators of system performance.
引用
收藏
相关论文
共 50 条
  • [41] A Hadoop Processing Method for Massive Sensor Network Data Based on Internet of Things
    Zhang, Yanxin
    INTERNATIONAL JOURNAL OF WIRELESS INFORMATION NETWORKS, 2020, 27 (02) : 299 - 306
  • [42] Floating Car Data Processing Model Based on Hadoop-GIS Tools
    Deng, Zhu
    Bai, Yuqi
    2016 FIFTH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS (AGRO-GEOINFORMATICS), 2016, : 46 - 49
  • [43] Research on Data Processing for Condition Monitoring of Wind Turbine Based on Hadoop Platform
    Wang, Hongjun
    Zhao, Shaowei
    Zhao, Hui
    Yue, Youjun
    2017 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2017, : 322 - 326
  • [44] An Enhanced Apriori Algorithm Using Hybrid Data Layout Based on Hadoop for Big Data Processing
    Rochd, Yassir
    Hafidi, Imad
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2018, 18 (06): : 161 - 167
  • [45] IC-Data: Improving Compressed Data Processing in Hadoop
    Haider, Adnan
    Yang, Xi
    Liu, Ning
    Sun, Xian-He
    He, Shuibing
    2015 IEEE 22nd International Conference on High Performance Computing (HiPC), 2015, : 356 - 365
  • [46] Towards Efficient Big Data: Hadoop Data Placing and Processing
    Bahadi, Jihane
    El Asri, Bouchra
    Courtine, Melanie
    Rhanoui, Maryem
    Kergosien, Yannick
    2ND INTERNATIONAL CONFERENCE ON SMART DIGITAL ENVIRONMENT (ICSDE'18), 2018, : 42 - 47
  • [47] Data Deduplication based on Hadoop
    Zhang, Dongzhan
    Liao, Chengfa
    Yan, Wenjing
    Tao, Ran
    Zheng, Wei
    2017 FIFTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2017, : 147 - 152
  • [48] The data quality analysis in telecom
    Qin, Hai-fei
    ADVANCES IN MECHATRONICS AND CONTROL ENGINEERING, PTS 1-3, 2013, 278-280 : 1826 - 1829
  • [49] Extensions to the Pig Data Processing Platform for Scalable RDF Data Processing Using Hadoop
    Tanimura, Yusuke
    Matono, Akiyoshi
    Lynden, Steven
    Kojima, Isao
    2010 IEEE 26TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDE 2010), 2010, : 251 - 256
  • [50] Research on Industry Data Analysis Model Based on Hadoop Big Data Platform
    Xu, Hongsheng
    Fan, Ganglong
    Li, Ke
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, INFORMATION AND COMPUTER SCIENCE (ICEMC 2017), 2017, 73 : 783 - 787