Application Traffic Classification in Hadoop Distributed Computing Environment

被引:0
|
作者
Shim, Kyu-Seok [1 ]
Lee, Su-Kang [1 ]
Kim, Myung-Sup [1 ]
机构
[1] Korea Univ, Dept Comp & Informat Sci, Sejong, South Korea
来源
2014 16TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS) | 2014年
基金
新加坡国家研究基金会;
关键词
Hadoop; Payload; Traffic; Distribute; Signature;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Today, network traffic has increased because of the appearance of various applications and services. However, methods for network traffic analysis are not developed to catch up the trend of increasing usage of the network. Most methods for network traffic analysis are operated on a single server environment, which results in the limits about memory, processing speed, storage capacity. When considering the increment of network traffic, we need a method of network traffic to handle the Bigdata traffic. Hadoop system can be effectively used for analyzing Bigdata traffic. In this paper, we propose a method of application traffic classification in Hadoop distributed computing system and compare the processing time of the proposed system with a single server system to show the advantages of Hadoop.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] LOG ANALYSIS IN CLOUD COMPUTING ENVIRONMENT WITH HADOOP AND SPARK
    Lin, Xiuqin
    Wang, Peng
    Wu, Bin
    2013 5TH IEEE INTERNATIONAL CONFERENCE ON BROADBAND NETWORK & MULTIMEDIA TECHNOLOGY (IC-BNMT), 2013, : 273 - 276
  • [2] Deadline scheduling algorithm for sustainable computing in Hadoop environment
    Varga, Mihai
    Petrescu-Nita, Alina
    Pop, Florin
    COMPUTERS & SECURITY, 2018, 76 : 354 - 366
  • [3] A framework for distributed nearest neighbor classification using Hadoop
    Ding Q.
    Boykin R.
    Ding, Qin (dingq@ecu.edu), 1600, IOS Press BV (17): : S11 - S19
  • [4] Analysis of distributed computing architecture search principle based on Hadoop
    Duan, Ailing
    Cao, Dan
    Si, Haifang
    COMPUTER AND INFORMATION TECHNOLOGY, 2014, 519-520 : 54 - 57
  • [5] Source camera identification: a distributed computing approach using Hadoop
    Faiz, Muhammad
    Anuar, Nor Badrul
    Wahab, Ainuddin Wahid Abdul
    Shamshirband, Shahaboddin
    Chronopoulos, Anthony T.
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2017, 6
  • [6] Performance Evaluation of Distributed Computing Environments with Hadoop and Spark Frameworks
    Taran, Vladyslav
    Alienin, Oleg
    Stirenko, Sergii
    Gordienko, Yuri
    Rojbi, A.
    2017 IEEE INTERNATIONAL YOUNG SCIENTISTS FORUM ON APPLIED PHYSICS AND ENGINEERING (YSF), 2017, : 80 - 83
  • [7] Source camera identification: a distributed computing approach using Hadoop
    Muhammad Faiz
    Nor Badrul Anuar
    Ainuddin Wahid Abdul Wahab
    Shahaboddin Shamshirband
    Anthony T. Chronopoulos
    Journal of Cloud Computing, 6
  • [8] Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters
    Kaitoua, Abdulrahman
    Hajj, Hazem
    Saghir, Mazen A. R.
    Artail, Hassan
    Akkary, Haitham
    Awad, Mariette
    Sharafeddine, Mageda
    Mershad, Khaleel
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2014, 11 (02) : 191 - 216
  • [9] The Performance Evaluation of a Distributed Image Classification Pipeline Based on Hadoop and MapReduce with Initial Application to Medical Images
    Guo, Shujian
    Zhang, Yaonan
    Wu, Qiushi
    Niu, Lechuan
    Zhang, Wenwei
    Li, Songbai
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2018, 8 (01) : 78 - 83
  • [10] The Optimization of Hadoop Scheduling Algorithms on Distributed System for Processing Traffic Information
    Sun, Weizhen
    Wang, Xiujin
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON SOFT COMPUTING TECHNIQUES AND ENGINEERING APPLICATION, ICSCTEA 2013, 2014, 250 : 389 - 396