Real-time User-click Recognition Based on Spark Streaming

被引:0
作者
Lin, Xiangyue [1 ]
Liu, Fang [1 ]
Liu, Jun [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Lab Adv Informat Networks, Beijing Key Lab Network Syst Architecture & Conve, Beijing, Peoples R China
来源
PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC) | 2017年
基金
中国国家自然科学基金;
关键词
user-click; real-time; analysis of user behavior; GRAPH;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
With the rapid development of internet, data produced by users tends to be larger. The web page structure is becoming more and more complex and contains more and more different types of embedded objects as well. How to identify the user click requests from a large number of data set, is the first step as well as one of the difficulty of analysis of user behavior. Based on the spark streaming algorithm and some other previous algorithms, this paper proposes a real-time user-click recognition algorithm. The experimental results show that our algorithm is with high accuracy and is suitable for large scale data processing.
引用
收藏
页码:2532 / 2536
页数:5
相关论文
共 13 条
[1]  
Ben Houidi Z, 2014, LECT NOTES COMPUT SC, V8406, P91, DOI 10.1007/978-3-642-54999-1_8
[2]   Web User-Session Inference by Means of Clustering Techniques [J].
Bianco, Andrea ;
Mardente, Gianluca ;
Mellia, Marco ;
Munafo, Maurizio ;
Muscariello, Luca .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2009, 17 (02) :405-416
[3]   Referrer Graph: A cost-effective algorithm and pruning method for predicting web accesses [J].
de la Ossa, B. ;
Gil, J. A. ;
Sahuquillo, J. ;
Pont, A. .
COMPUTER COMMUNICATIONS, 2013, 36 (08) :881-894
[4]  
Ericsson A. B., 2015, ERICSSON MOBILITY RE
[5]  
Fang C., 2016, IEEE ACCESS, V11, P13
[6]  
Fang C., 2016, IEEE ACCESS, V68, P1
[7]   Parallelized User Clicks Recognition from Massive HTTP Data Based on Dependency Graph Model [J].
Fang Cheng ;
Liu Jun ;
Lei Zhenming .
CHINA COMMUNICATIONS, 2014, 11 (12) :13-25
[8]  
Fu YJ, 2000, LECT NOTES COMPUT SC, V1836, P21
[9]  
Hyoung-Kee Choi, 1999, Proceedings Seventh International Conference on Network Protocols (ICNP'99), P327, DOI 10.1109/ICNP.1999.801961
[10]   ClickMiner: Towards Forensic Reconstruction of User-Browser Interactions from Network Traces [J].
Neasbitt, Christopher ;
Perdisci, Roberto ;
Li, Kang ;
Nelms, Terry .
CCS'14: PROCEEDINGS OF THE 21ST ACM CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2014, :1244-1255