Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

被引:153
作者
Mehrotra, Rishabh [1 ]
McInerney, James [1 ]
Bouchard, Hugues [1 ]
Lalmas, Mounia [1 ]
Diaz, Fernando [2 ,3 ]
机构
[1] Spotify Res, Stockholm, Sweden
[2] Microsoft Res, Montreal, PQ, Canada
[3] Spotify, Stockholm, Sweden
来源
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT | 2018年
关键词
ECONOMICS;
D O I
10.1145/3269206.3272027
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Two-sided marketplaces are platforms that have customers not only on the demand side (e.g. users), but also on the supply side (e.g. retailer, artists). While traditional recommender systems focused specifically towards increasing consumer satisfaction by providing relevant content to consumers, two-sided marketplaces face the problem of additionally optimizing for supplier preferences, and visibility. Indeed, the suppliers would want a fair opportunity to be presented to users. Blindly optimizing for consumer relevance may have a detrimental impact on supplier fairness. Motivated by this problem, we focus on the trade-off between objectives of consumers and suppliers in the case of music streaming services, and consider the trade-off between relevance of recommendations to the consumer (i.e. user) and fairness of representation of suppliers (i.e. artists) and measure their impact on consumer satisfaction. We propose a conceptual and computational framework using counterfactual estimation techniques to understand, and evaluate different recommendation policies, specifically around the trade-off between relevance and fairness, without the need for running many costly A/B tests. We propose a number of recommendation policies which jointly optimize relevance and fairness, thereby achieving substantial improvement in supplier fairness without noticeable decline in user satisfaction. Additionally, we consider user disposition towards fair content, and propose a personalized recommendation policy which takes into account consumer's tolerance towards fair content. Our findings could guide the design of algorithms powering two-sided marketplaces, as well as guide future research on sophisticated algorithms for joint optimization of user relevance, satisfaction and fairness.
引用
收藏
页码:2243 / 2251
页数:9
相关论文
共 31 条
  • [1] Abdollahpouri H., P UMAP 2017
  • [2] Abebe Rediet, P AAMAS 2017
  • [3] [Anonymous], 2018, ARXIV180207281
  • [4] [Anonymous], 2012, ARXIV12061754
  • [5] Competition in two-sided markets
    Armstrong, Mark
    [J]. RAND JOURNAL OF ECONOMICS, 2006, 37 (03) : 668 - 691
  • [6] Biega Asia J, 2018, ARXIV180501788
  • [7] Burke Robin, 2017, arXiv preprint arXiv:1707.00093
  • [8] Dwork Cynthia, P ITCS 2012
  • [9] Eisenmann T, 2006, HARVARD BUS REV, V84, P92
  • [10] Feild Henry A, SIGIR 2010