Co-producing AIED Ethics Under Lockdown: an Empirical Study of Deliberative Democracy in Action

被引:3
作者
Swist, Teresa [1 ,2 ]
Shum, Simon Buckingham [3 ]
Gulson, Kalervo N. [1 ]
机构
[1] Univ Sydney, Sydney Sch Educ & Social Work, Camperdown, NSW, Australia
[2] Western Sydney Univ, Inst Culture & Soc, Parramatta, NSW, Australia
[3] Univ Technol Sydney, Connected Intelligence Ctr, Ultimo, NSW, Australia
基金
澳大利亚研究理事会;
关键词
Educational technology; Learning analytics; Artificial intelligence; Ethics; Deliberative democracy; Organisational learning; Co-production; Socio-technical controversies; LEARNING ANALYTICS; TOOL;
D O I
10.1007/s40593-023-00380-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
It is widely documented that higher education institutional responses to the COVID-19 pandemic accelerated not only the adoption of educational technologies, but also associated socio-technical controversies. Critically, while these cloud-based platforms are capturing huge datasets, and generating new kinds of learning analytics, there are few strongly theorised, empirically validated processes for institutions to consult their communities about the ethics of this data-intensive, increasingly algorithmically-powered infrastructure. Conceptual and empirical contributions to this challenge are made in this paper, as we focus on the under-theorised and under-investigated phase required for ethics implementation, namely, joint agreement on ethical principles. We foreground the potential of ethical co-production through Deliberative Democracy (DD), which emerged in response to the crisis in confidence in how typical democratic systems engage citizens in decision making. This is tested empirically in the context of a university-wide DD consultation, conducted under pandemic lockdown conditions, co-producing a set of ethical principles to govern Analytics/AI-enabled Educational Technology (AAI-EdTech). Evaluation of this process takes the form of interviews conducted with students, educators, and leaders. Findings highlight that this methodology facilitated a unique and structured co-production process, enabling a range of higher education stakeholders to integrate their situated knowledge through dialogue. The DD process and product cultivated commitment and trust among the participants, informing a new university AI governance policy. The concluding discussion reflects on DD as an exemplar of ethical co-production, identifying new research avenues to advance this work. To our knowledge, this is the first application of DD for AI ethics, as is its use as an organisational sensemaking process in education.
引用
收藏
页码:670 / 705
页数:36
相关论文
共 60 条
[21]  
Gulson K. N., 2022, AUTOMATED ESSAY SCOR, DOI [10.25910/e8nn-q994, DOI 10.25910/E8NN-Q994]
[22]   The Ethics of AI Ethics: An Evaluation of Guidelines [J].
Hagendorff, Thilo .
MINDS AND MACHINES, 2020, 30 (01) :99-120
[23]   Towards a Critical Race Methodology in Algorithmic Fairness [J].
Hanna, Alex ;
Denton, Emily ;
Smart, Andrew ;
Smith-Loud, Jamila .
FAT* '20: PROCEEDINGS OF THE 2020 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, 2020, :501-512
[24]   Empowering online teachers through predictive learning analytics [J].
Herodotou, Christothea ;
Hlosta, Martin ;
Boroowa, Avinash ;
Rienties, Bart ;
Zdrahal, Zdenek ;
Mangafa, Chrysoula .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2019, 50 (06) :3064-3079
[25]   Ethics of AI in Education: Towards a Community-Wide Framework [J].
Holmes, Wayne ;
Porayska-Pomsta, Kaska ;
Holstein, Ken ;
Sutherland, Emma ;
Baker, Toby ;
Shum, Simon Buckingham ;
Santos, Olga C. ;
Rodrigo, Mercedes T. ;
Cukurova, Mutlu ;
Bittencourt, Ig Ibert ;
Koedinger, Kenneth R. .
INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2022, 32 (03) :504-526
[26]  
Holmes Wayne., 2022, ETHICS ARTIFICIAL IN
[27]   Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher-AI Complementarity [J].
Holstein, Kenneth ;
McLaren, Bruce M. ;
Aleven, Vincent .
JOURNAL OF LEARNING ANALYTICS, 2019, 6 (02) :27-52
[28]   Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? [J].
Holstein, Kenneth ;
Vaughan, Jennifer Wortman ;
Daume, Hal, III ;
Dudik, Miroslav ;
Wallach, Hanna .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[29]  
IEEE, 2017, ETH AL DES
[30]  
Jasanoff S., 2004, States of Knowledge: The Co-Production of Science and Social Order