Design and Development of a Unified Query Platform as Middleware for NoSQL Data Stores

被引:0
作者
Valentine, Hadwin [1 ]
Kabaso, Boniface [1 ]
机构
[1] Cape Peninsula Univ Technol, Fac Informat & Design, Cape Town, South Africa
关键词
Unified query; polyglot; NoSQL; middleware; query processing; big data; SCIENCE;
D O I
10.14569/IJACSA.2024.0150762
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The advancements in technology such as Web 2.0, 3.0, mobile devices and recently IoT devices has given rise to a massive amount of structured, semi-structure and unstructured datasets, i.e. big data. The increasing complexity and diversity of data sources poses significant challenges for stakeholders when extracting meaningful insights. This paper demonstrates how we developed a unified query prototype as middleware using a polyglot technique capable of interrogating and manipulating the four categories of NoSQL data models. This study applied established algorithms to different aspects of the prototype to attain this study's objective. . The prototype was subjected to an experiment where varying query workloads were processed. The performance data comprised of application performance index, memory consumption, and execution time and error rates. The results demonstrated that the prototype had a low error rate indicating ing it's robustness and reliability. In addition, the results showed that the prototype is responsive and able to query the underlying storage system effectively and efficiently. The prototype provides a standardize set of operations abstracting the complexities of each underlying storage system; reducing the need for multiple data retrieval management systems.
引用
收藏
页码:628 / 646
页数:19
相关论文
共 50 条
  • [41] Development of a lightweight CAE middleware for CAE data exchange
    Song, I. -H.
    Yang, J.
    Jo, H.
    Choi, S.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2009, 22 (09) : 823 - 835
  • [42] Content Filtering-based Data Distribution for Middleware Joint Test Platform
    Du, Zhiyuan
    Jin, Zhenzhong
    Bo, Yun
    [J]. 2018 EIGHTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC 2018), 2018, : 1320 - 1322
  • [43] Virtual Sensor Middleware: Managing IoT Data for the Fog-Cloud Platform
    AlMahamid, Fadi
    Lutfiyya, Hanan
    Grolinger, Katarina
    [J]. 2022 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2022, : 41 - 48
  • [44] A Distributed Stream Processing Middleware Framework for Real-Time Analysis of Heterogeneous Data on Big Data Platform: Case of Environmental Monitoring
    Akanbi, Adeyinka
    Masinde, Muthoni
    [J]. SENSORS, 2020, 20 (11) : 1 - 25
  • [45] Middleware Design for Measurement Data Exchange in a Smart Sensor Network
    Annamraju, Sphurthi
    Gumudavelli, Suman
    Wang, Ray
    Gurkan, Deniz
    [J]. 2010 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE I2MTC 2010, PROCEEDINGS, 2010,
  • [46] A fresh approach for hybrid SQL/NoSQL database design based on data structuredness
    Bjeladinovic, Srdja
    [J]. ENTERPRISE INFORMATION SYSTEMS, 2018, 12 (8-9) : 1202 - 1220
  • [47] Design of a Novel Cloud Terminal Adaptation Platform Based on Mobile Web-Middleware
    Wu, Yiqiong
    Fu, Weiwei
    Shao, Jingcheng
    Chen TianZhou
    [J]. 2013 FIRST INTERNATIONAL SYMPOSIUM ON FUTURE INFORMATION AND COMMUNICATION TECHNOLOGIES FOR UBIQUITOUS HEALTHCARE (UBI-HEALTHTECH), 2013,
  • [48] The Framework of Data Distribution Management with Region Match Method of Middleware in Joint Test Platform
    Du, Zhiyuan
    Liu, Shuai
    Liao, Xuejun
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5856 - 5860
  • [49] A Cypher Query based NoSQL Data Mining on Protein Datasets using Neo4j Graph Database
    Johnpaul, C., I
    Mathew, Tojo
    [J]. 2017 4TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2017,
  • [50] Design and Implementation of Data Middle Platform
    Zheng Haotian
    Li Tao
    Yan Song
    [J]. PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,