Design and Development of a Unified Query Platform as Middleware for NoSQL Data Stores

被引:0
作者
Valentine, Hadwin [1 ]
Kabaso, Boniface [1 ]
机构
[1] Cape Peninsula Univ Technol, Fac Informat & Design, Cape Town, South Africa
关键词
Unified query; polyglot; NoSQL; middleware; query processing; big data; SCIENCE;
D O I
10.14569/IJACSA.2024.0150762
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The advancements in technology such as Web 2.0, 3.0, mobile devices and recently IoT devices has given rise to a massive amount of structured, semi-structure and unstructured datasets, i.e. big data. The increasing complexity and diversity of data sources poses significant challenges for stakeholders when extracting meaningful insights. This paper demonstrates how we developed a unified query prototype as middleware using a polyglot technique capable of interrogating and manipulating the four categories of NoSQL data models. This study applied established algorithms to different aspects of the prototype to attain this study's objective. . The prototype was subjected to an experiment where varying query workloads were processed. The performance data comprised of application performance index, memory consumption, and execution time and error rates. The results demonstrated that the prototype had a low error rate indicating ing it's robustness and reliability. In addition, the results showed that the prototype is responsive and able to query the underlying storage system effectively and efficiently. The prototype provides a standardize set of operations abstracting the complexities of each underlying storage system; reducing the need for multiple data retrieval management systems.
引用
收藏
页码:628 / 646
页数:19
相关论文
共 50 条
  • [31] Parallel Polyglot Query Processing on Heterogeneous Cloud Data Stores with LeanXcale
    Kolev, Boyan
    Levchenko, Oleksandra
    Pacitti, Esther
    Valduriez, Patrick
    Vilaca, Ricardo
    Goncalves, Rui
    Jimenez-Peris, Ricardo
    Kranas, Pavlos
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 1757 - 1766
  • [32] Palpatine: Mining Frequent Sequences for Data Prefetching in NoSQL Distributed Key-Value Stores
    Estevest, Sergio
    Silva, Joao Nuno
    Veiga, Luis
    2020 IEEE 19TH INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS (NCA), 2020,
  • [33] Review of NoSQL Data Stores: Using a reactive three-tier application for software developers to achieve a high availability application design architecture
    Hendricks, Waldon
    2019 OPEN INNOVATIONS CONFERENCE (OI), 2019, : 71 - 77
  • [34] NoSQL Distributed Big Data Storage Technology and Application Based on Cloud Platform
    Lu Zheng-Wu
    PROCEEDINGS OF THE 2017 7TH INTERNATIONAL CONFERENCE ON ADVANCED DESIGN AND MANUFACTURING ENGINEERING (ICADME 2017), 2017, 136 : 334 - 340
  • [35] NotaQL Is Not a Query Language! It's for Data Transformation on Wide-Column Stores
    Schildgen, Johannes
    Dessloch, Stefan
    DATA SCIENCE, 2015, 9147 : 139 - 151
  • [36] A WebGIS Platform Design and Implementation Based On Open Source GIS Middleware
    Lv, Dekui
    Ying, Xiaxin
    Gao, Xibao
    Tao, Weidong
    Cui, Yanjun
    Hua, Tingting
    2016 24TH INTERNATIONAL CONFERENCE ON GEOINFORMATICS (GEOINFORMATICS), 2016,
  • [37] Mobile Medical Data Synchronization on Cloud-Powered Middleware Platform
    Lomotey, Richard K.
    Nilson, JoAnn
    Mulder, Kathy
    Wittmeier, Kristy
    Schachter, Candice
    Deters, Ralph
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2016, 9 (05) : 757 - 770
  • [38] Introducing extreme data storage middleware of schema-free document stores using MapReduce
    Ma, Kun
    Yang, Bo
    INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2015, 20 (04) : 274 - 284
  • [39] Design of middleware for interactive data services in the terrestrial DMB
    Lee, Gwangsoon
    Yang, KyuTae
    Kim, Kwang-Yong
    Hahm, YoungKwon
    Ahn, Chunghyun
    Lee, Soo-In
    ETRI JOURNAL, 2006, 28 (05) : 652 - 655
  • [40] Design and Development of a Network Learning Platform Based on the Big Data Concept
    Liu, Jieying
    Jia, Shan
    Qiao, Qiao
    Li, Mang
    2018 SEVENTH INTERNATIONAL CONFERENCE OF EDUCATIONAL INNOVATION THROUGH TECHNOLOGY (EITT 2018), 2018, : 111 - 115