Parallel Processing of Image Segmentation Data Using Hadoop

被引:0
|
作者
Akhtar, M. Nishat [1 ]
Saleh, Junita Mohamad [2 ]
Grelck, C. [3 ]
机构
[1] Univ Sains Malaysia, Sch Aerosp Engn, Nibong Tebal 14300, Penang, Malaysia
[2] Univ Sains Malaysia, Sch Elect & Elect Engn, Nibong Tebal 14300, Penang, Malaysia
[3] Univ Amsterdam, Informat Inst, Sci Pk 904, Amsterdam, Netherlands
来源
INTERNATIONAL JOURNAL OF INTEGRATED ENGINEERING | 2018年 / 10卷 / 01期
关键词
Parallel computation; Image segmentation; Hadoop; HIPI; Map-reduce; Input split;
D O I
暂无
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The use of sequential programming is slowly getting replaced by distributed and parallel computing which is widely being used in computing industries to handle tasks with big data and various high-end computing applications comprising of huge image and video data banks. Moreover, image processing using parallel computation is also gaining momentum in today's technological era. Nowadays researchers are coming up with various methodologies to tackle high scale image processing applications by implementing parallel computing methodologies to carry out the specified image processing application task and simultaneously checking its performance against sequential programming. At the same time there are constraints on what can be done to maximize the task performance using high end multi-core CPU's with advanced buses and interconnects that offer high bandwidth with low system latency. It is to be noted that there is no availability of standardized image processing task which can be used to evaluate a single node system. In this paper, we propose an efficient parallel processing algorithm to perform the task of image segmentation with the foremost aim to analyze the threshold of data size at which the proposed method outperforms sequential programming method in terms of task execution time by analyzing the distribution of average CPU cores usage and its threads over the execution time. The proposed methodology could be useful for researchers, as it can perform multiple image segmentation in parallel, which can save a lot of time of the user. For the purpose of comparison, we also implemented the same image segmentation task using sequential method of programming in an integrated development environment platform.
引用
收藏
页码:74 / 84
页数:11
相关论文
共 50 条
  • [1] The design and implementation of image parallel processing framework based on Hadoop
    Wang, Shenkuo
    Wu, Shaofei
    Zhang, Huajie
    Xia, Ning
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 183 - 183
  • [2] Distributed Image Processing Using Hadoop and HIPI
    Arsh, Swapnil
    Bhatt, Abhishek
    Kumar, Praveen
    2016 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2016, : 2673 - 2676
  • [3] MIPr - a Framework for Distributed Image Processing Using Hadoop
    Sozykin, Andrey
    Epanchintsev, Timofei
    2015 9TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2015, : 35 - 39
  • [4] Parallel image processing with the block data parallel architecture
    Alexander, WE
    Reeves, DS
    Gloster, CS
    PROCEEDINGS OF THE IEEE, 1996, 84 (07) : 947 - 968
  • [5] Astronomical Image Processing with Hadoop
    Wiley, Keith
    Connolly, Andrew
    Krughoff, Simon
    Gardner, Jeff
    Balazinska, Magdalena
    Howe, Bill
    Kwon, YongChul
    Bu, Yingyi
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XX, 2011, 442 : 93 - 96
  • [6] Hadoop Image Processing Framework
    Vemula, Sridhar
    Crick, Christopher
    2015 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2015, 2015, : 506 - 513
  • [7] High Resolution Satellite Image Processing using Hadoop framework
    Rajak, Roshan
    Raveendran, Deepu
    Chandrasekhar, Maruthi Bh
    Medasani, Shanti Swarup
    2015 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2016, : 16 - 21
  • [8] Extensions to the Pig Data Processing Platform for Scalable RDF Data Processing Using Hadoop
    Tanimura, Yusuke
    Matono, Akiyoshi
    Lynden, Steven
    Kojima, Isao
    2010 IEEE 26TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDE 2010), 2010, : 251 - 256
  • [9] A data and task parallel image processing environment
    Nicolescu, C
    Jonker, P
    PARALLEL COMPUTING, 2002, 28 (7-8) : 945 - 965
  • [10] Big Data Processing Using Hadoop and Spark: The Case of Meteorology Data
    Hussein, Eslam
    Sadiki, Ronewa
    Jafta, Yahlieel
    Sungay, Muhammad Mujahid
    Ajayi, Olasupo
    Bagula, Antoine
    E-INFRASTRUCTURE AND E-SERVICES FOR DEVELOPING COUNTRIES (AFRICOMM 2019), 2020, 311 : 180 - 185