Data Mesh: A Systematic Gray Literature Review

被引:2
作者
Goedegebuure, Abel [1 ]
Kumara, Indika [1 ]
Driessen, Stefan [1 ]
van den Heuvel, Willem-jan [1 ]
Monsieur, Geert [1 ]
Tamburri, Damian andrew [2 ]
DI Nucci, Dario [3 ]
机构
[1] Tilburg Univ, Jheronimus Acad Data Sci, Tilburg, Netherlands
[2] Tech Univ Eindhoven, Jheronimus Acad Data Sci, Eindhoven, Netherlands
[3] Univ Salerno, Fisciano, Campania, Italy
关键词
Data mesh; principles; reference architectures; research challenges; gray; literature review; data architecture; data management; OF-THE-ART; WEB SERVICES; FRAMEWORK;
D O I
10.1145/3687301
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Data mesh is an emerging domain-driven decentralized data architecture that aims to minimize or avoid operational bottlenecks associated with centralized, monolithic data architectures in enterprises. The topic has piqued the practitioners' interest, and considerable gray literature exists. At the same time, we observe a lack of academic attempts at defining and building upon the concept. Hence, in this article, we aim to start from the foundations and characterize the data mesh architecture regarding its design principles, architectural components, capabilities, and organizational roles. We systematically collected, analyzed, and synthesized 114 industrial gray literature articles. The resulting review provides insights into practitioners' perspectives on the four key principles of data mesh: data as a product, domain ownership of data, self-serve data platform, and federated computational governance. Moreover, due to the comparability of data mesh and SOA (serviceoriented architecture), we mapped the findings from the gray literature into the reference architectures from the SOA academic literature to create the reference architectures for describing three key dimensions of data mesh: organization of capabilities and roles, development, and runtime. Finally, we discuss open research issues in data mesh, partially based on the findings from the gray literature.
引用
收藏
页数:36
相关论文
共 183 条
[1]  
Aaboud M, 2021, J HIGH ENERGY PHYS, DOI 10.1007/JHEP02(2021)143
[2]   Open data from the first and second observing runs of Advanced LIGO and Advanced Virgo [J].
Abbott, Rich ;
Abbott, Thomas D. ;
Abraham, Sheelu ;
Acernese, Fausto ;
Ackley, Kendall ;
Adams, Carl ;
Adhikari, Rana X. ;
Adya, Vaishali B. ;
Affeldt, Christoph ;
Agathos, Michalis ;
Agatsuma, Kazuhiro ;
Aggarwal, Nancy ;
Aguiar, Odylio D. ;
Aich, Amit ;
Aiello, Lorenzo ;
Ain, Anirban ;
Parameswaran, Ajith ;
Allen, Gabrielle ;
Allocca, Annalisa ;
Altin, Paul A. ;
Amato, Alex ;
Anand, Shreya ;
Ananyeva, Alena ;
Anderson, Stuart B. ;
Anderson, Warren G. ;
Angelova, Svetoslava, V ;
Ansoldi, Stefano ;
Antier, Sarah ;
Appert, Stephen ;
Arai, Koji ;
Araya, Melody C. ;
Areeda, Joseph S. ;
Arene, Marc ;
Arnaud, Nicolas ;
Aronson, Scott M. ;
Arun, Kg G. ;
Ascenzi, Stefano ;
Ashton, Gregory ;
Aston, Stuart M. ;
Astone, Pia ;
Aubin, Florian ;
Aufmuth, Peter ;
AultONeal, Kellie ;
Austin, Corey ;
Avendano, Valerie ;
Babak, Stanislav ;
Bacon, Philippe ;
Badaracco, Francesca ;
Bader, Maria K. M. ;
Bae, Sangwook .
SOFTWAREX, 2021, 13
[3]   Joint analysis of Dark Energy Survey Year 3 data and CMB lensing from SPT and Planck. III. Combined cosmological constraints [J].
Abbott, T. M. C. ;
Aguena, M. ;
Alarcon, A. ;
Alves, O. ;
Amon, A. ;
Andrade-Oliveira, F. ;
Annis, J. ;
Ansarinejad, B. ;
Avila, S. ;
Bacon, D. ;
Baxter, E. J. ;
Bechtol, K. ;
Becker, M. R. ;
Benson, B. A. ;
Bernstein, G. M. ;
Bertin, E. ;
Blazek, J. ;
Bleem, L. E. ;
Bocquet, S. ;
Brooks, D. ;
Buckley-Geer, E. ;
Burke, D. L. ;
Camacho, H. ;
Campos, A. ;
Carlstrom, J. E. ;
Rosell, A. Carnero ;
Kind, M. Carrasco ;
Carretero, J. ;
Cawthon, R. ;
Chang, C. ;
Chang, C. L. ;
Chen, R. ;
Choi, A. ;
Chown, R. ;
Conselice, C. ;
Cordero, J. ;
Costanzi, M. ;
Crawford, T. ;
Crites, A. T. ;
Crocce, M. ;
da Costa, L. N. ;
Davis, C. ;
Davis, T. M. ;
de Haan, T. ;
De Vicente, J. ;
DeRose, J. ;
Desai, S. ;
Diehl, H. T. ;
Dobbs, M. A. ;
Dodelson, S. .
PHYSICAL REVIEW D, 2023, 107 (02)
[4]   Drones and Architectural Visualization: Exploring Building (Re)Presentation Through Thermal Patterns Data [J].
Abd Manan, Mohd Shahrudin ;
Abd Halin, Al-Fhaliq Naabil .
ADVANCES IN CIVIL ENGINEERING MATERIALS, 2023, 310 :205-212
[5]   Data governance: A conceptual framework, structured review, and research agenda [J].
Abraham, Rene ;
Schneider, Johannes ;
vom Brocke, Jan .
INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 49 :424-438
[6]  
Adevinta, 2021, Building a Data Mesh to Support an Ecosystem of Data Products at Adevinta
[7]  
AgileLab, 2021, Data Mesh Explanation: How and Why Successful Data-Driven Companies Are Adopting Data Mesh
[8]   A systematic literature review of data governance and cloud data governance [J].
Al-Ruithe, Majid ;
Benkhelifa, Elhadj ;
Hameed, Khawar .
PERSONAL AND UBIQUITOUS COMPUTING, 2019, 23 (5-6) :839-859
[9]   Recommender systems in model-driven engineering A systematic mapping review [J].
Almonte, Lissette ;
Guerra, Esther ;
Cantador, Ivan ;
de Lara, Juan .
SOFTWARE AND SYSTEMS MODELING, 2022, 21 (01) :249-280
[10]   Galaxy clustering in harmonic space from the dark energy survey year 1 data: compatibility with real-space results [J].
Andrade-Oliveira, F. ;
Camacho, H. ;
Faga, L. ;
Gomes, R. ;
Rosenfeld, R. ;
Troja, A. ;
Alves, O. ;
Doux, C. ;
Elvin-Poole, J. ;
Fang, X. ;
Friedrich, O. ;
Kokron, N. ;
Lima, M. ;
Miranda, V ;
Pandey, S. ;
Porredon, A. ;
Sanchez, J. ;
Aguena, M. ;
Allam, S. ;
Annis, J. ;
Avila, S. ;
Bertin, E. ;
Brooks, D. ;
Burke, D. L. ;
Kind, M. Carrasco ;
Carretero, J. ;
Cawthon, R. ;
Chang, C. ;
Choi, A. ;
Costanzi, M. ;
Crocce, M. ;
da Costa, L. N. ;
Pereira, M. E. S. ;
Desai, S. ;
Diehl, H. T. ;
Doel, P. ;
Drlica-Wagner, A. ;
Everett, S. ;
Evrard, A. E. ;
Ferrero, I ;
Frieman, J. ;
Garcia-Bellido, J. ;
Gaztanaga, E. ;
Gerdes, D. W. ;
Gruen, D. ;
Gruendl, R. A. ;
Hinton, S. R. ;
Hollowood, D. L. ;
Jain, B. ;
James, D. J. .
MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2021, 505 (04) :5714-5724