Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence

被引:42
作者
Herrmann, Thomas [1 ]
Pfeiffer, Sabine [2 ]
机构
[1] Ruhr Univ Bochum, Informat & Technol Management, Inst Arbeitswissensch, D-44780 Bochum, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg, Chair Sociol Technol Labour Soc, Nuremberg Campus Technol NCT, D-90429 Nurnberg, Germany
关键词
Artificial intelligence; Machine learning; Human-centered AI; Organizational practices; Socio-technical design; Predictive maintenance; Digital work; FRAMEWORK; MACHINES; DESIGN; AL;
D O I
10.1007/s00146-022-01391-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The human-centered AI approach posits a future in which the work done by humans and machines will become ever more interactive and integrated. This article takes human-centered AI one step further. It argues that the integration of human and machine intelligence is achievable only if human organizations-not just individual human workers-are kept "in the loop." We support this argument with evidence of two case studies in the area of predictive maintenance, by which we show how organizational practices are needed and shape the use of AI/ML. Specifically, organizational processes and outputs such as decision-making workflows, etc. directly influence how AI/ML affects the workplace, and they are crucial for answering our first and second research questions, which address the pre-conditions for keeping humans in the loop and for supporting continuous and reliable functioning of AI-based socio-technical processes. From the empirical cases, we extrapolate a concept of "keeping the organization in the loop" that integrates four different kinds of loops: AI use, AI customization, AI-supported original tasks, and taking contextual changes into account. The analysis culminates in a systematic framework of keeping the organization in the loop look based on interacting organizational practices.
引用
收藏
页码:1523 / 1542
页数:20
相关论文
共 88 条
[1]   Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) [J].
Adadi, Amina ;
Berrada, Mohammed .
IEEE ACCESS, 2018, 6 :52138-52160
[2]   Power to the People: The Role of Humans in Interactive Machine Learning [J].
Amershi, Saleema ;
Cakmak, Maya ;
Knox, W. Bradley ;
Kulesza, Todd .
AI MAGAZINE, 2014, 35 (04) :105-120
[3]   Trusting Intelligent Machines Deepening Trust within Socio-Technical Systems [J].
Andras, Peter ;
Esterle, Lukas ;
Guckert, Michael ;
The Anh Han ;
Lewis, Peter R. ;
Milanovic, Kristina ;
Payne, Terry ;
Perret, Cedric ;
Pitt, Jeremy ;
Powers, Simon T. ;
Urquhart, Neil ;
Wells, Simon .
IEEE TECHNOLOGY AND SOCIETY MAGAZINE, 2018, 37 (04) :76-83
[4]  
[Anonymous], 1999, Collaborative-learning: Cognitive and computational approaches
[5]  
Athey SC, 2020, 26673 NBER, DOI [10.3386/w26673, DOI 10.3386/W26673]
[6]   The Moral Machine experiment [J].
Awad, Edmond ;
Dsouza, Sohan ;
Kim, Richard ;
Schulz, Jonathan ;
Henrich, Joseph ;
Shariff, Azim ;
Bonnefon, Jean-Francois ;
Rahwan, Iyad .
NATURE, 2018, 563 (7729) :59-+
[7]   Socio-technical systems: From design methods to systems engineering [J].
Baxter, Gordon ;
Sommerville, Ian .
INTERACTING WITH COMPUTERS, 2011, 23 (01) :4-17
[8]   Super-intelligent machine: technological exuberance or the road to subjection [J].
Broedner, Peter .
AI & SOCIETY, 2018, 33 (03) :335-346
[9]   Profound change is coming, but roles for humans remain [J].
Brynjolfsson, Erik ;
Mitchell, Tom .
SCIENCE, 2017, 358 (6370) :1530-1534
[10]   Hello Ai: Uncovering the onboarding needs of medical practitioners for human–AI collaborative decision-making [J].
Cai, Carrie J. ;
Winter, Samantha ;
Steiner, David ;
Wilcox, Lauren ;
Terry, Michael .
Proceedings of the ACM on Human-Computer Interaction, 2019, 3 (CSCW)