On-the-fly Data Transformation in Action

被引:1
|
作者
Mun, Ju Hyoung [1 ]
Karatsenidis, Konstantinos [1 ]
Papon, Tarikul Islam [1 ]
Roozkhosh, Shahin [1 ]
Hoornaert, Denis [2 ]
Drepper, Ulrich [3 ]
Sanaullah, Ahmed [3 ]
Mancuso, Renato [1 ]
Athanassoulis, Manos [1 ]
机构
[1] Boston Univ, Boston, MA 02215 USA
[2] Tech Univ Munich, Munich, Germany
[3] Red Hat, Raleigh, NC USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2023年 / 16卷 / 12期
基金
美国国家科学基金会;
关键词
D O I
10.14778/3611540.3611593
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transactional and analytical database management systems (DBMS) typically employ different data layouts: row-stores for the first and column-stores for the latter. In order to bridge the requirements of the two without maintaining two systems and two (or more) copies of the data, our proposed system Relational Memory employs specialized hardware that transforms the base row table into arbitrary column groups at query execution time. This approach maximizes the cache locality and is easy to use via a simple abstraction that allows transparent on-the-fly data transformation. Here, we demonstrate how to deploy and use Relational Memory via four representative scenarios. The demonstration uses the full-stack implementation of Relational Memory on the Xilinx Zynq UltraScale+ MPSoC platform. Conference participants will interact with Relational Memory deployed in the actual platform.
引用
收藏
页码:3950 / 3953
页数:4
相关论文
共 50 条
  • [1] ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation
    Kara, Kaan
    Eguro, Ken
    Zhang, Ce
    Alonso, Gustavo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2018, 12 (04): : 348 - 361
  • [2] HST data flow with on-the-fly reprocessing
    Swade, DA
    Hopkins, E
    Swam, MS
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS X, 2001, 238 : 295 - 298
  • [3] ON-THE-FLY OPTIMIZATION OF DATA-STRUCTURES
    KESSELS, JLW
    COMMUNICATIONS OF THE ACM, 1983, 26 (11) : 895 - 901
  • [4] On-the-fly calibration system for the ISO Data Archive
    Osuna, P
    Arviset, C
    Saxton, R
    Pollock, A
    Verdugo, E
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS IX, 2000, 216 : 195 - 198
  • [5] On-The-Fly Data Integration Models for Biological Databases
    Naidu, Pavithra G.
    Palakal, Mathew J.
    Hartanto, Shielly
    APPLIED COMPUTING 2007, VOL 1 AND 2, 2007, : 118 - +
  • [6] A practical method for on-the-fly data race detection
    Ryu, EK
    Ha, KS
    Yoo, KY
    APPLIED PARALLEL COMPUTING: ADVANCED SCIENTIFIC COMPUTING, 2002, 2367 : 264 - 273
  • [7] On-the-fly Data Compression for Efficient TCP Transmission
    Wang, Min
    Wang, Junfeng
    Mou, Xuan
    Han, Sunyoung
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2013, 7 (03): : 471 - 489
  • [8] On-the-Fly Hierarchies for Numerical Attributes in Data Anonymization
    Campan, Alina
    Cooper, Nicholas
    SECURE DATA MANAGEMENT, 2010, 6358 : 13 - 25
  • [9] On-The-Fly error correction in storage data channels
    Wan, Zhikun
    Zhang, Jiangling
    Xiaoxing Weixing Jisuanji Xitong/Mini-Micro Systems, 19 (07): : 45 - 48
  • [10] On-the-fly Particle Filter Registration for Laser Data
    Rink, Christian
    Kriegel, Simon
    Hasse, Jakob
    Marton, Zoltan-Csaba
    PROCEEDING OF 2016 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, QUALITY AND TESTING, ROBOTICS (AQTR), 2016, : 469 - 474