A distributed data mining system framework for mobile internet access log based on hadoop

被引：0

作者：

Jiang, Yunliang ^{[1
,3
]}

Yang, Jiangang ^{[3
]}

Tang, Liang ^{[4
]}

Liu, Yong ^{[2
]}

Zhao, Xiaoming ^{[5
]}

Hao, Xiulan ^{[1
]}

机构：

[1] School of Information Engineering, Huzhou University, Huzhou

[2] National Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou

[3] School of Computer Science, Hangzhou Dianzi University, Hangzhou

[4] China Ship Development and Design Center, Wuhan

[5] School of Mathematics and Information Engineering, Taizhou University, Linhai

来源：

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 2015年 / 8971卷

基金：

中国国家自然科学基金;

关键词：

Cloud computing; Datamine; Hadoop; Hive; Mobile phone web log;

D O I：

10.1007/978-3-662-48247-6_23

中图分类号：

学科分类号：

摘要：

Because of the popularity of mobile phone and the development of mobile network, mobile data is growing explosively. Mobile data mining is more and more of attention. But single node-based data mining platform has been unable to store and analysis the massive data. According to cloud computing technology, we preset a distributed data mining framework based on Hadoop. Then, we present the implementation of this system framework and process mobile internet access log on the Hadoop cluster. Comparative tests will show that this distributed system framework is significantly efficient for processing huge scale dataset. © Springer-Verlag Berlin Heidelberg 2015.

引用

页码：243 / 252

页数：9

共 50 条

[41] Distributed Content Based Image Search Engine using Hadoop Framework
Uttarwar, Dhananjay
Agarwal, Aakash
Kadiwar, Riyaz
Katkar, Vijay D.
2017 INTERNATIONAL CONFERENCE ON COMMUNICATION AND SIGNAL PROCESSING (ICCSP), 2017, : 1706 - 1710
[42] A Parallel Sequential SBAS Processing Framework Based on Hadoop Distributed Computing
Wu, Zhenning
Lv, Xiaolei
Yun, Ye
Duan, Wei
REMOTE SENSING, 2024, 16 (03)
[43] Research on database massive data processing and mining method based on hadoop cloud platform
Xiaoyong, Zhao
Chunrong, Yang
Open Automation and Control Systems Journal, 2014, 6 (01): : 1463 - 1467
[44] Research on Database Massive Data Processing and Mining Method based on Hadoop Cloud Platform
Wu, Dan
Li, Zhuorong
Bie, Rongfang
Zhou, Mingquan
2014 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI 2014), 2014, : 107 - 110
[45] Building Hybrid Recommendation System Based on Hadoop Framework
Prasad, Arupananda Girish
Gourisaria, Mahendra Kumar
Vashishtha, Lalit Kumar
2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 3493 - 3499
[46] A system based on Hadoop for radar data analysis
Chi Yang
Xiaomin Yang
Feng Yang
Journal of Ambient Intelligence and Humanized Computing, 2019, 10 : 3899 - 3913
[47] Data-Intensive Workload Consolidation for the Hadoop Distributed File System
Moraveji, Reza
Taheri, Javid
Reza, Mohammad
Rizvandi, Nikzad Babaii
Zomaya, Albert Y.
2012 ACM/IEEE 13TH INTERNATIONAL CONFERENCE ON GRID COMPUTING (GRID), 2012, : 95 - 103
[48] An analysis platform of road traffic management system log data based on distributed storage and parallel computing techniques
Peng, Wei
Li, Yongjiang
Li, Bing
Zhu, Xiangyuan
PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCES ON BIG DATA AND CLOUD COMPUTING (BDCLOUD 2016) SOCIAL COMPUTING AND NETWORKING (SOCIALCOM 2016) SUSTAINABLE COMPUTING AND COMMUNICATIONS (SUSTAINCOM 2016) (BDCLOUD-SOCIALCOM-SUSTAINCOM 2016), 2016, : 585 - 589
[49] A system based on Hadoop for radar data analysis
Yang, Chi
Yang, Xiaomin
Yang, Feng
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2019, 10 (10) : 3899 - 3913
[50] Analysis of DNA Data Using Hadoop Distributed File System.
Senthilkumar, M.
Ilango, P.
RESEARCH JOURNAL OF PHARMACEUTICAL BIOLOGICAL AND CHEMICAL SCIENCES, 2016, 7 (03): : 796 - 803

← 1 2 3 4 5 →