Implementing Federated Governance in Data Mesh Architecture

被引:0
作者
Dolhopolov, Anton [1 ]
Castelltort, Arnaud [1 ]
Laurent, Anne [1 ]
机构
[1] Univ Montpellier, LIRMM, CNRS, F-34095 Montpellier, France
关键词
decentralized systems; federated governance; metadata management; data mesh; blockchain;
D O I
10.3390/fi16040115
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Analytical data platforms have been used for decades to improve organizational performance. Starting from the data warehouses used primarily for structured data processing, through the data lakes oriented for raw data storage and post-hoc data analyses, to the data lakehouses-a combination of raw storage and business intelligence pre-processing for improving the platform's efficacy. But in recent years, a new architecture called Data Mesh has emerged. The main promise of this architecture is to remove the barriers between operational and analytical teams in order to boost the overall value extraction from the big data. A number of attempts have been made to formalize and implement it in existing projects. Although being defined as a socio-technical paradigm, data mesh still lacks the technology support to enable its widespread adoption. To overcome this limitation, we propose a new view of the platform requirements alongside the formal governance definition that we believe can help in the successful adoption of the data mesh. It is based on fundamental aspects such as decentralized data domains and federated computational governance. In addition, we also present a blockchain-based implementation of a mesh platform as a practical validation of our theoretical proposal. Overall, this article demonstrates a novel research direction for information system decentralization technologies.
引用
收藏
页数:17
相关论文
共 39 条
  • [1] Business Data Sharing through Data Marketplaces: A Systematic Literature Review
    Abbas, Antragama Ewa
    Agahari, Wirawan
    van de Ven, Montijn
    Zuiderwijk, Anneke
    de Reuver, Mark
    [J]. JOURNAL OF THEORETICAL AND APPLIED ELECTRONIC COMMERCE RESEARCH, 2021, 16 (07): : 3321 - 3339
  • [2] Abel G., 2022, Master's Thesis
  • [3] Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains
    Androulaki, Elli
    Barger, Artem
    Bortnikov, Vita
    Cachin, Christian
    Christidis, Konstantinos
    De Caro, Angelo
    Enyeart, David
    Ferris, Christopher
    Laventman, Gennady
    Manevich, Yacov
    Muralidharan, Srinivasan
    Murthy, Chet
    Binh Nguyen
    Sethi, Manish
    Singh, Gari
    Smith, Keith
    Sorniotti, Alessandro
    Stathakopoulou, Chrysoula
    Vukolic, Marko
    Cocco, Sharon Weed
    Yellick, Jason
    [J]. EUROSYS '18: PROCEEDINGS OF THE THIRTEENTH EUROSYS CONFERENCE, 2018,
  • [4] [Anonymous], 2017, DAMA DMBOK DATA MANA, V2nd
  • [5] Apache Software Foundation, Apache Atlas-Data Governance and Metadata Framework for Hadoop
  • [6] Armbrust M., 2021, Proceedings of CIDR
  • [7] Protecting sensitive data in the cloud-to-edge continuum: The FogProtect approach
    Ayed, Dhouha
    Dragan, Paul-Andrei
    Felix, Edith
    Mann, Zoltan Adam
    Salant, Eliot
    Seidl, Robert
    Sidiropoulos, Anestis
    Taylor, Steve
    Vitorino, Ricardo
    [J]. 2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 279 - 288
  • [8] Butte V.K., 2022, P 2022 INT C DAT AN, P62
  • [9] DataHub Project, The Metadata Platform for the Modern Data Stack
  • [10] Dehghani Z., 2022, Data Mesh