OceanRoute: Vessel Mobility Data Processing and Analyzing Model Based on MapReduce

被引:1
|
作者
Liu Chao [1 ]
Liu Yingjian [1 ]
Guo Zhongwen [1 ]
Jing Wei [1 ]
机构
[1] Ocean Univ China, Dept Comp Sci & Technol, Qingdao 266100, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
ocean delay tolerant network; MapReduce; mobility pattern; trace similarity; vessel data analysis;
D O I
10.1007/s11802-018-3396-y
中图分类号
P7 [海洋学];
学科分类号
0707 ;
摘要
The network coverage is a big problem in ocean communication, and there is no low-cost solution in the short term. Based on the knowledge of Mobile Delay Tolerant Network (MDTN), the mobility of vessels can create the chances of end-to-end communication. The mobility pattern of vessel is one of the key metrics on ocean MDTN network. Because of the high cost, few experiments have focused on research of vessel mobility pattern for the moment. In this paper, we study the traces of more than 4000 fishing and freight vessels. Firstly, to solve the data noise and sparsity problem, we design two algorithms to filter the noise and complement the missing data based on the vessel's turning feature. Secondly, after studying the traces of vessels, we observe that the vessel's traces are confined by invisible boundary. Thirdly, through defining the distance between traces, we design MR-Similarity algorithm to find the mobility pattern of vessels. Finally, we realize our algorithm on cluster and evaluate the performance and accuracy. Our results can provide the guidelines on design of data routing protocols on ocean MDTN.
引用
收藏
页码:594 / 602
页数:9
相关论文
共 50 条
  • [21] Distributed XPath Query Processing over Large XML Data based on MapReduce framework
    Fan, Hongjie
    Wang, Dongsheng
    Liu, Junfei
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1447 - 1453
  • [22] A Survey of MapReduce based Parallel Processing Technologies
    Lu Jiamin
    Feng Jun
    CHINA COMMUNICATIONS, 2014, 11 (02) : 146 - 155
  • [23] A Scalable XSLT Processing Framework based on MapReduce
    Li, Ren
    Luo, Jianhua
    Yang, Dan
    Hu, Haibo
    Chen, Ling
    JOURNAL OF COMPUTERS, 2013, 8 (09) : 2175 - 2181
  • [24] Sensor data compression based on MapReduce
    YU Yu
    GUO Zhong-wen
    The Journal of China Universities of Posts and Telecommunications, 2014, (01) : 60 - 66
  • [25] Analysis of the Big Data based on MapReduce
    Tian, Zi-de
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTOMATION, MECHANICAL CONTROL AND COMPUTATIONAL ENGINEERING, 2015, 124 : 224 - 228
  • [26] Locality Based Data Partitioning in MapReduce
    Wang, Chunguang
    Wu, Qingbo
    Tan, Yusong
    Wang, Wenzhu
    Wu, Quanyuan
    2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013), 2013, : 1310 - 1317
  • [27] GCMR: A GPU Cluster-based MapReduce Framework for Large-scale Data Processing
    Guo, Yiru
    Liu, Weiguo
    Gong, Bin
    Voss, Gerrit
    Mueller-Wittig, Wolfgang
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 580 - 586
  • [28] Research the Data Analysis and Processing Comparison between MapReduce and Spark
    Raigoza, Jaime
    Parmar, Vijay
    2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE & COMPUTATIONAL INTELLIGENCE (CSCI), 2016, : 1401 - 1402
  • [29] An efficient MapReduce scheduling scheme for processing large multimedia data
    Bok, Kyoungsoo
    Hwang, Jaemin
    Lim, Jongtae
    Kim, Yeonwoo
    Yoo, Jaesoo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (16) : 17273 - 17296
  • [30] Optimizing Cloud MapReduce for Processing Stream Data using Pipelining
    Karve, Rutvik
    Dahiphale, Devendra
    Chhajer, Amit
    UKSIM FIFTH EUROPEAN MODELLING SYMPOSIUM ON COMPUTER MODELLING AND SIMULATION (EMS 2011), 2011, : 344 - 349