OmniFair: A Declarative System for Model-Agnostic Group Fairness in Machine Learning

被引:20
|
作者
Zhang, Hantian [1 ]
Chu, Xu [1 ]
Asudeh, Abolfazl [2 ]
Navathe, Shamkant B. [1 ]
机构
[1] Georgia Inst Technol, Atlanta, GA 30332 USA
[2] Univ Illinois, Chicago, IL USA
来源
SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA | 2021年
关键词
Algorithmic Bias; Group Fairness; Declarative Systems;
D O I
10.1145/3448016.3452787
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine learning (ML) is increasingly being used to make decisions in our society. ML models, however, can be unfair to certain demographic groups (e.g., African Americans or females) according to various fairness metrics. Existing techniques for producing fair ML models either are limited to the type of fairness constraints they can handle (e.g., preprocessing) or require nontrivial modifications to downstream ML training algorithms (e.g., in-processing). We propose a declarative system Omni Fair for supporting group fairness in ML. Omni Fair features a declarative interface for users to specify desired group fairness constraints and supports all commonly used group fairness notions, including statistical parity, equalized odds, and predictive parity. Omni Fair is also model-agnostic in the sense that it does not require modifications to a chosen ML algorithm. Omni Fair also supports enforcing multiple user declared fairness constraints simultaneously while most previous techniques cannot. The algorithms in Omni Fair maximize model accuracy while meeting the specified fairness constraints, and their efficiency is optimized based on the theoretically provable monotonicity property regarding the trade-off between accuracy and fairness that is unique to our system. We conduct experiments on commonly used datasets that exhibit bias against minority groups in the fairness literature. We show that OmniFair is more versatile than existing algorithmic fairness approaches in terms of both supported fairness constraints and downstream ML models. OmniFair reduces the accuracy loss by up to 94.8% compared with the second best method. Omni Fair also achieves similar running time to preprocessing methods, and is up to 270x faster than in-processing methods.
引用
收藏
页码:2076 / 2088
页数:13
相关论文
共 50 条
  • [31] The Research about Recurrent Model-Agnostic Meta Learning
    Chen, Shaodong
    Niu, Ziyu
    OPTICAL MEMORY AND NEURAL NETWORKS, 2020, 29 (01) : 56 - 67
  • [32] Explanation-driven Self-adaptation using Model-agnostic Interpretable Machine Learning
    Negri, Francesco Renato
    Nicolosi, Niccolo
    Camilli, Matteo
    Mirandola, Raffaela
    PROCEEDINGS OF THE 2024 IEEE/ACM 19TH SYMPOSIUM ON SOFTWARE ENGINEERING FOR ADAPTIVE AND SELF-MANAGING SYSTEMS, SEAMS 2024, 2024, : 189 - 199
  • [33] Learning from Class-imbalanced Data with a Model-Agnostic Framework for Machine Intelligent Diagnosis
    Wu, Jingyao
    Zhao, Zhibin
    Sun, Chuang
    Yan, Ruqiang
    Chen, Xuefeng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2021, 216
  • [34] Revisiting Model-Agnostic Private Learning: Faster Rates and Active Learning
    Liu, Chong
    Zhu, Yuqing
    Chaudhuri, Kamalika
    Wang, Yu-Xiang
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [35] Meta weight learning via model-agnostic meta-learning
    Xu, Zhixiong
    Chen, Xiliang
    Tang, Wei
    Lai, Jun
    Cao, Lei
    NEUROCOMPUTING, 2021, 432 : 124 - 132
  • [36] Revisiting model-agnostic private learning: Faster rates and active learning
    Liu, Chong
    Zhu, Yuqing
    Chaudhuri, Kamalika
    Wang, Yu-Xiang
    Journal of Machine Learning Research, 2021, 22
  • [37] Combining Model-Agnostic Meta-Learning and Transfer Learning for Regression
    Satrya, Wahyu Fadli
    Yun, Ji-Hoon
    SENSORS, 2023, 23 (02)
  • [38] Enhancing Fairness in Classification Tasks with Multiple Variables: A Data- and Model-Agnostic Approach
    d'Aloisio, Giordano
    Stilo, Giovanni
    Di Marco, Antinisca
    D'Angelo, Andrea
    ADVANCES IN BIAS AND FAIRNESS IN INFORMATION RETRIEVAL, BIAS 2022, 2022, 1610 : 117 - 129
  • [39] PEER-TO-PEER MODEL-AGNOSTIC META-LEARNING
    Qureshi, Muhammad I.
    Khan, Usman A.
    2024 IEEE 13RD SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP, SAM 2024, 2024,
  • [40] Deep Learning Model-Agnostic Controller for VTOL Class UAS
    Holmes, Grant
    Chowdhury, Mozammal
    McKinnis, Aaron
    Keshmiri, Shawn
    2022 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS), 2022, : 1520 - 1529