Human-Curated Validation of Machine Learning Algorithms for Health Data

被引:0
作者
Magnus Boman
机构
[1] KTH Royal Institute of Technology,Software and Computer Sciences (EECS/SCS)
[2] Karolinska Institutet,Division of Clinical Epidemiology, Department of Medicine Solna and LIME
[3] Karolinska University Hospital,MedTechLabs, BioClinicum
[4] Solna,undefined
来源
Digital Society | 2023年 / 2卷 / 3期
关键词
Gold standard; Ground truth; Health data; Machine learning; Deep learning; Artificial intelligence; Validation; Bias;
D O I
10.1007/s44206-023-00076-w
中图分类号
学科分类号
摘要
Validation of machine learning algorithms that take health data as input is analysed, leveraging on an example from radiology. A 2-year study of AI use in a university hospital and a connected medical university indicated what was often forgotten by human decision makers in the clinic and by medical researchers. A nine-item laundry list that does not require machine learning expertise to use resulted. The list items guide stakeholders toward complete validation processes and clinical routines for bias-aware, sound, energy-aware and efficient data-driven reasoning for health. The list can also prove useful to machine learning developers, as a list of minimal requirements for successful implementation in the clinic.
引用
收藏
相关论文
共 57 条
[1]  
Adamson AS(2019)Machine learning and the cancer-diagnosis problem-no gold standard The New England Journal of Medicine 381 2285-2287
[2]  
Welch HG(2022)Predicting cancer outcomes with radiomics and artificial intelligence in radiology Nature Reviews Clinical Oncology 19 132-146
[3]  
Bera K(2019)Learning machines in internet-delivered psychological treatment Progress in Artificial Intelligence 8 475-485
[4]  
Braman N(2020)Toward learning machines at a mother and baby unit Frontiers in Psychology 11 143-152
[5]  
Gupta A(2015)Sensemaking in intelligent health data analytics KI-Künstliche Intelligenz 29 199-231
[6]  
Velcheti V(2001)Statistical modeling: The two cultures (with comments and a rejoinder by the author) Statistical Science 16 A1-A2
[7]  
Madabhushi A(2015)Registered reports: Realigning incentives in scientific publishing Cortex 66 523-539
[8]  
Boman M(2020)In AI we trust incrementally: A multi-layer model of trust to analyze human-artificial intelligence interactions Philosophy & Technology 33 108782-278
[9]  
Ben Abdesslem F(2022)Pre-registration of mathematical models Mathematical Biosciences 345 266-123
[10]  
Forsell E(2021)Examining the robustness of observational associations to model, measurement and sampling uncertainty with the vibration of effects framework International Journal of Epidemiology 50 100-432