Acceleration of HadoopMapReduce using in-memory Computing

被引：0
|
作者：
Seelam, Siva Kumar [1 ]
Pattabiraman, V [1 ]
机构：
[1] Vellore Inst Technol, Sch Comp Sci & Engn, Chennai, Tamil Nadu, India
来源：
PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON RECENT TRENDS IN ADVANCED COMPUTING (ICRTAC-CPS 2018) | 2018年
关键词：
Bigdata; Hadoop; MapReduce; FPGA; acceleration; logic gates; Ignite; Distributed environment;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In now a day, the data in real time is increasing exponentially. This data is generating from every corner of the earth viz., social networks, sensors mainly from IoT (trending technology), e-commerce site, GPS signals etc. This data may be in form of structured, semi-structured or unstructured. Currently, tech companies, for example, Facebook, Amazon, Twitter, YouTube and Google handle big data sets around terabytes or petabytes of data per day. Therefore, this data is to be analyzed or processed. It is not easy to process the whole data. The first solution to such big data problems is Hadoop. Hadoop uses Hadoop Distributed File System (HDFS) to store the data. Though Hadoop gives solution to big data problems, it takes more time to produce the results. The most important constraint in this 21st century is time. In this paper, acceleration of Hadoop using Apache Ignite Filesystem that acts in in-memory instead of HDFS.
引用
收藏
页码：91 / 96
页数：6
相关论文
共 50 条
  • [1] Deep learning acceleration based on in-memory computing
    Eleftheriou, E.
    Le Gallo, M.
    Nandakumar, S. R.
    Piveteau, C.
    Boybat, I
    Joshi, V
    Khaddam-Aljameh, R.
    Dazzi, M.
    Giannopoulos, I
    Karunaratne, G.
    Kersting, B.
    Stanisavljevic, M.
    Jonnalagadda, V. P.
    Ioannou, N.
    Kourtis, K.
    Francese, P. A.
    Sebastian, A.
    IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2019, 63 (06)
  • [2] Efficient Acceleration of Stencil Applications through In-Memory Computing
    Yantir, Hasan Erdem
    Eltawil, Ahmed M.
    Salama, Khaled N.
    MICROMACHINES, 2020, 11 (06)
  • [3] Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration
    Krishnan, Gokul
    Wang, Zhenyu
    Yeo, Injune
    Yang, Li
    Meng, Jian
    Liehr, Maximilian
    Joshi, Rajiv, V
    Cady, Nathaniel C.
    Fan, Deliang
    Seo, Jae-Sun
    Cao, Yu
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (11) : 4241 - 4252
  • [4] Vesti: An In-Memory Computing Processor for Deep Neural Networks Acceleration
    Jiang, Zhewei
    Yin, Shihui
    Kim, Minkyu
    Gupta, Tushar
    Seok, Mingoo
    Seo, Jae-sun
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1516 - 1521
  • [5] In-memory computing using electrical and photonic memory devices
    Sebastian, Abu
    2019 CONFERENCE ON LASERS AND ELECTRO-OPTICS EUROPE & EUROPEAN QUANTUM ELECTRONICS CONFERENCE (CLEO/EUROPE-EQEC), 2019,
  • [6] Design and implementation of reconfigurable acceleration for in-memory distributed big data computing
    Hou, Junjie
    Zhu, Yongxin
    Du, Sen
    Song, Shijin
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 92 : 68 - 75
  • [7] Kernel approximation using analogue in-memory computing
    Buechel, Julian
    Camposampiero, Giacomo
    Vasilopoulos, Athanasios
    Lammie, Corey
    Le Gallo, Manuel
    Rahimi, Abbas
    Sebastian, Abu
    NATURE MACHINE INTELLIGENCE, 2024, : 1605 - 1615
  • [8] Reliable In-Memory Neuromorphic Computing using Spintronics
    Muench, Christopher
    Bishnoi, Rajendra
    Tahoori, Mehdi B.
    24TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC 2019), 2019, : 230 - 236
  • [9] In-memory computing with ferroelectrics
    Rui Yang
    Nature Electronics, 2020, 3 : 237 - 238
  • [10] Computing In-Memory, Revisited
    Milojicic, Dejan
    Bresniker, Kirk
    Campbell, Gary
    Faraboschi, Paolo
    Strachan, John Paul
    Williams, Stan
    2018 IEEE 38TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2018, : 1300 - 1309
12345