Trustworthy AI in the public sector: An empirical analysis of a Swedish labor market decision-support system

被引:15
|
作者
Berman, Alexander [1 ]
Licht, Karl de Fine [2 ]
Carlsson, Vanja [3 ]
机构
[1] Univ Gothenburg, Ctr Linguist Theory & Studies Probabil CLASP, Dept Philosophy Linguist & Theory Sci, Box 200, S-40530 Gothenburg, Sweden
[2] Chalmers Univ Technol, Div Sci Technol & Soc, Gothenburg, Sweden
[3] Univ Gothenburg, Sch Publ Adm, Gothenburg, Sweden
关键词
Decision -support systems; Trustworthy AI; Artificial Intelligence; Public employment services; Public sector;
D O I
10.1016/j.techsoc.2024.102471
中图分类号
D58 [社会生活与社会问题]; C913 [社会生活与社会问题];
学科分类号
摘要
This paper investigates the deployment of Artificial Intelligence (AI) in the Swedish Public Employment Service (PES), focusing on the concept of trustworthy AI in public decision -making. Despite Sweden's advanced digitalization efforts and the widespread application of AI in the public sector, our study reveals significant gaps between theoretical ambitions and practical outcomes, particularly in the context of AI's trustworthiness. We employ a robust theoretical framework comprising Institutional Theory, the Resource -Based View (RBV), and Ambidexterity Theory, to analyze the challenges and discrepancies in AI implementation within PES. Our analysis shows that while AI promises enhanced decision -making efficiency, the reality is marred by issues of transparency, interpretability, and stakeholder engagement. The opacity of the neural network used by the agency to assess jobseekers' need for support and the lack of comprehensive technical understanding among PES management contribute to the challenges in achieving transparent and interpretable AI systems. Economic pressures for efficiency often overshadow the need for ethical considerations and stakeholder involvement, leading to decisions that may not be in the best interest of jobseekers. We propose recommendations for enhancing AI's trustworthiness in public services, emphasizing the importance of stakeholder engagement, particularly involving jobseekers in the decision -making process. Our study advocates for a more nuanced balance between the use of advanced AI technologies and the leveraging of internal resources such as skilled personnel and organizational knowledge. We also highlight the need for improved AI literacy among both management and personnel to effectively navigate AI's integration into public decision -making processes. Our findings contribute to the ongoing debate on trustworthy AI, offering a detailed case study that bridges the gap between theoretical exploration and practical application. By scrutinizing the AI implementation in the Swedish PES, we provide valuable insights and guidelines for other public sector organizations grappling with the integration of AI into their decision -making processes.
引用
收藏
页数:15
相关论文
共 11 条
  • [1] Requirements for trustworthy AI-enabled automated decision-making in the public sector: A systematic review
    Agbabiaka, Olusegun
    Ojo, Adegboyega
    Connolly, Niall
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2025, 215
  • [2] Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
    Dlugatch, Rachel
    Georgieva, Antoniya
    Kerasidou, Angeliki
    BMC MEDICAL ETHICS, 2023, 24 (01)
  • [3] Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
    Rachel Dlugatch
    Antoniya Georgieva
    Angeliki Kerasidou
    BMC Medical Ethics, 24
  • [4] AI-based decision support system for public procurement
    Siciliani, Lucia
    Taccardi, Vincenzo
    Basile, Pierpaolo
    Di Ciano, Marco
    Lops, Pasquale
    INFORMATION SYSTEMS, 2023, 119
  • [5] User Interface Design for AI-Based Clinical Decision-Support System Preliminary Study
    Beltrao, Gabriela
    Paramonova, Iuliia
    Sousa, Sonia
    2022 17TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2022,
  • [6] A DECISION-SUPPORT SYSTEM FOR STOCHASTIC COST-VOLUME-PROFIT ANALYSIS
    RAVICHANDRAN, R
    DECISION SUPPORT SYSTEMS, 1993, 10 (04) : 379 - 399
  • [7] Performance analysis of a fuzzy decision-support system for culling of dairy cows
    Lacroix, R
    Strasser, M
    Kok, R
    Wade, KM
    CANADIAN AGRICULTURAL ENGINEERING, 1998, 40 (02): : 139 - 152
  • [8] Hybrid decision support based on knowledge discovery and AI techniques for the management of maintenance services in the public transport sector
    Adamson, Ken
    Campbell, Piers
    Orsoni, Alessandra
    2005 IEEE INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS, 2005, : 674 - 678
  • [9] Implementing a clinical decision-support system in practice: A qualitative analysis of influencing attitudes and characteristics among general practitioners
    Toth-Pal, Eva
    Wardh, Inger
    Strender, Lars-Erik
    Nilsson, Gunnar
    INFORMATICS FOR HEALTH & SOCIAL CARE, 2008, 33 (01) : 39 - 54
  • [10] A collaborative group decision-support system: the survey based multi-actor multi-criteria analysis (MAMCA) software
    Huang, He
    Burgherr, Peter
    Macharis, Cathy
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2025, 76 (05) : 844 - 865