Breaking the Bias: Gender Fairness in LLMs Using Prompt Engineering and In-Context Learning

被引:3
作者
Dwivedi, Satyam [1 ]
Ghosh, Sanjukta [2 ]
Dwivedi, Shivam [1 ]
机构
[1] IIT BHU, HSS, Varanasi, India
[2] IIT BHU, HSS, Linguist, Varanasi, India
关键词
Prompt engineering; In-context learning; Gender bias; Large Language Models; Equitable content; Bias mitigation strategies;
D O I
10.21659/rupkatha.v15n4.10
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Large Language Models (LLMs) have been identified as carriers of societal biases, particularly in gender representation. This study introduces an innovative approach employing prompt engineering and incontext learning to rectify these biases in LLMs. Through our methodology, we effectively guide LLMs to generate more equitable content, emphasizing nuanced prompts and in -context feedback. Experimental results on openly available LLMs such as BARD, ChatGPT, and LLAMA2-Chat indicate a significant reduction in gender bias, particularly in traditionally problematic areas such as 'Literature'. Our findings underscore the potential of prompt engineering and in -context learning as powerful tools in the quest for unbiased AI language models.
引用
收藏
页数:18
相关论文
共 18 条
[1]  
Alec Radford., 2019, OpenAI Blog, V1
[2]   On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? [J].
Bender, Emily M. ;
Gebru, Timnit ;
McMillan-Major, Angelina ;
Shmitchell, Shmargaret .
PROCEEDINGS OF THE 2021 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, FACCT 2021, 2021, :610-623
[3]  
Blodgett SL, 2020, Arxiv, DOI [arXiv:2005.14050, 10.48550/arXiv.2005.14050, DOI 10.48550/ARXIV.2005.14050]
[4]  
Bolukbasi T, 2016, ADV NEUR IN, V29
[5]  
Brown TB, 2020, ADV NEUR IN, V33
[6]  
Chowdhery A., 2022, Palm: Scaling language modeling with pathways
[7]  
Datta Amit, 2015, Proceedings on Privacy Enhancing Technologies, V1, P92, DOI [10.1515/popets-2015-0007, 10.1515/popets-2015-0007]
[8]  
Kojima T, 2022, ADV NEUR IN
[9]   The Selective Labels Problem: Evaluating Algorithmic Predictions in the Presence of Unobservables [J].
Lakkaraju, Himabindu ;
Kleinberg, Jon ;
Leskovec, Jure ;
Ludwig, Jens ;
Mullainathan, Sendhil .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :275-284
[10]  
Liang PP, 2021, PR MACH LEARN RES, V139