Data quality for federated medical data lakes

被引:7
作者
Eder, Johann [1 ]
Shekhovtsov, Vladimir A. [1 ]
机构
[1] Univ Klagenfurt, Klagenfurt, Austria
关键词
Biobank; Metadata; Data quality; Data lake; Privacy; LOINC; Metadata and ontologies; INFORMATION-SYSTEMS; HEALTH-CARE; IMPLEMENTATION; INTEGRATION; BIOBANKS;
D O I
10.1108/IJWIS-03-2021-0026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Purpose Medical research requires biological material and data collected through biobanks in reliable processes with quality assurance. Medical studies based on data with unknown or questionable quality are useless or even dangerous, as evidenced by recent examples of withdrawn studies. Medical data sets consist of highly sensitive personal data, which has to be protected carefully and is available for research only after the approval of ethics committees. The purpose of this research is to propose an architecture to support researchers to efficiently and effectively identify relevant collections of material and data with documented quality for their research projects while observing strict privacy rules. Design/methodology/approach Following a design science approach, this paper develops a conceptual model for capturing and relating metadata of medical data in biobanks to support medical research. Findings This study describes the landscape of biobanks as federated medical data lakes such as the collections of samples and their annotations in the European federation of biobanks (Biobanking and Biomolecular Resources Research Infrastructure - European Research Infrastructure Consortium, BBMRI-ERIC) and develops a conceptual model capturing schema information with quality annotation. This paper discusses the quality dimensions for data sets for medical research in-depth and proposes representations of both the metadata and data quality documentation with the aim to support researchers to effectively and efficiently identify suitable data sets for medical studies. Originality/value This novel conceptual model for metadata for medical data lakes has a unique focus on the high privacy requirements of the data sets contained in medical data lakes and also stands out in the detailed representation of data quality and metadata quality of medical data sets.
引用
收藏
页码:407 / 426
页数:20
相关论文
共 50 条
[41]   Data Lakes: A Survey Paper [J].
Cherradi, Mohamed ;
EL Haddadi, Anass .
6TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS, 2022, 393 :823-835
[42]   Metadata Management for Data Lakes [J].
Ravat, Franck ;
Zhao, Yan .
NEW TRENDS IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2019, 2019, 1064 :37-44
[43]   Data quality probes - A synergistic method for quality monitoring of electronic medical record data accuracy and healthcare provision [J].
Brown, PJB ;
Harwood, J ;
Brantigan, P .
MEDINFO 2001: PROCEEDINGS OF THE 10TH WORLD CONGRESS ON MEDICAL INFORMATICS, PTS 1 AND 2, 2001, 84 :1116-1119
[44]   A Review of the State of the Art of Data Quality in Healthcare [J].
Liu, Caihua ;
Talaei-Khoei, Amir ;
Storey, Veda C. ;
Peng, Guochao .
JOURNAL OF GLOBAL INFORMATION MANAGEMENT, 2023, 31 (01) :25-25
[45]   Generic model of metadata management system for data lakes [J].
Elkina, Hamza ;
Sahib, Mohamed Rida ;
Zaki, Taher .
International Journal of Metadata, Semantics and Ontologies, 2023, 16 (04) :315-328
[46]   Federated Learning for Data Analytics in Education [J].
Fachola, Christian ;
Tornaria, Agustin ;
Bermolen, Paola ;
Capdehourat, German ;
Etcheverry, Lorena ;
Fariello, Maria Ines .
DATA, 2023, 8 (02)
[47]   A survey on federated learning in data mining [J].
Yu, Bin ;
Mao, Wenjie ;
Lv, Yihan ;
Zhang, Chen ;
Xie, Yu .
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2022, 12 (01)
[48]   The data quality improvement plan: deciding on choice and sequence of data quality improvements [J].
Kleindienst, Dominikus .
ELECTRONIC MARKETS, 2017, 27 (04) :387-398
[49]   Victimization (V) of Big Data: A Solution Using Federated Learning [J].
Shivkumar, S. ;
Supriya, M. .
SMART TRENDS IN COMPUTING AND COMMUNICATIONS, VOL 1, SMARTCOM 2024, 2024, 945 :171-182
[50]   Managing Sensor Data Uncertainty: A Data Quality Approach [J].
Rodriguez, Claudia C. Gutierrez ;
Servigne, Sylvie .
INTERNATIONAL JOURNAL OF AGRICULTURAL AND ENVIRONMENTAL INFORMATION SYSTEMS, 2013, 4 (01) :35-54