A distributed and mobile data mining system

被引:5
|
作者
Wang, F [1 ]
Na, HL [1 ]
Guo, Y [1 ]
Jin, H [1 ]
机构
[1] London Metropolitan Univ, Dept Comp, London N7 8DB, England
来源
PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT'2003, PROCEEDINGS | 2003年
关键词
distributed data mining; mobile data mining; PL/SQL; Oracle cursor; relational database; Heterogeneous Services agent; communication overhead;
D O I
10.1109/PDCAT.2003.1236449
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the popular data mining algorithms are designed to work for centralized data and they often do not pay attention to the resource constraints of distributed and mobile environments. In support of the third generation of data mining systems on distributed and massive data, we proposed an efficient distributed and mobile algorithm for global association rule mining, which does not need to ship all of local data to one site thereby not causing excessive network communication cost. The algorithm is implemented in PL/SQL for coupling association rule mining with relational database system, well-used in organizations and communities. The experiments show that this algorithm implemented in PL/SQL beats classic Apriori algorithm for large problem sizes, by factors ranging from 2 to more than 20, and this gap grows wider when the volume of transactions further grows up.
引用
收藏
页码:916 / 918
页数:3
相关论文
共 50 条
  • [41] Distributed data mining: a survey
    Zeng, Li
    Li, Ling
    Duan, Lian
    Lu, Kevin
    Shi, Zhongzhi
    Wang, Maoguang
    Wu, Wenjuan
    Luo, Ping
    INFORMATION TECHNOLOGY & MANAGEMENT, 2012, 13 (04): : 403 - 409
  • [42] Implementation of Distributed Crawler System Based on Spark for Massive Data Mining
    Liu, Feng
    Xin, Wang
    2020 5TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2020), 2020, : 482 - 485
  • [43] Performance Assessment for Distributed Information Fusion System Based on Data Mining
    He Yueshun
    Wang Hongling
    NANOTECHNOLOGY AND COMPUTER ENGINEERING, 2010, 121-122 : 534 - 539
  • [44] A Security-enabled Grid System for MINDS Distributed Data Mining
    Kim, Seonho
    Kim, Jinoh
    Weissman, Jon B.
    JOURNAL OF GRID COMPUTING, 2014, 12 (03) : 521 - 542
  • [45] A scheme of interactive data mining support system in parallel and distributed environment
    Liu, Z
    Kamohara, S
    Guo, MY
    PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, PROCEEDINGS, 2003, 2745 : 263 - 272
  • [46] Fourth Party Logistics System Based on CORBA Distributed Data Mining
    He Ping
    PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON SUSTAINABLE CONSTRUCTION & RISK MANAGEMENT, VOLS I AND II, 2010, : 272 - 275
  • [47] A Security-enabled Grid System for MINDS Distributed Data Mining
    Seonho Kim
    Jinoh Kim
    Jon B. Weissman
    Journal of Grid Computing, 2014, 12 : 521 - 542
  • [48] A data mining system for distributed abnormal event detection in backbone networks
    Zhou, Yingjie
    Hu, Guangmin
    Wu, Dapeng
    SECURITY AND COMMUNICATION NETWORKS, 2014, 7 (05) : 904 - 913
  • [49] Distributed data mining system based on multi-agent technology
    Guo, Li-Ming
    Zhang, Yan-Zhen
    Journal of Donghua University (English Edition), 2006, 23 (06) : 80 - 83
  • [50] Analysis and Application of Data Mining in CRM System of Some Mobile Branch
    Lou, Song-Tao
    Li, Ji-Rui
    Zheng, Wen-Bin
    INTELLIGENT COMPUTING THEORIES, 2013, 7995 : 47 - 54