From complexity to clarity: How AI enhances perceptions of scientists and the public's understanding of science

被引:1
作者
Markowitz, David M. [1 ]
机构
[1] Michigan State Univ, Dept Commun, E Lansing, MI 48824 USA
来源
PNAS NEXUS | 2024年 / 3卷 / 09期
关键词
science communication; generative AI; large language models; credibility; comprehension; LANGUAGE; WORDS; FLUENCY;
D O I
10.1093/pnasnexus/pgae387
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This article evaluated the effectiveness of using generative AI to simplify science communication and enhance the public's understanding of science. By comparing lay summaries of journal articles from PNAS, yoked to those generated by AI, this work first assessed linguistic simplicity differences across such summaries and public perceptions in follow-up experiments. Specifically, study 1a analyzed simplicity features of PNAS abstracts (scientific summaries) and significance statements (lay summaries), observing that lay summaries were indeed linguistically simpler, but effect size differences were small. Study 1b used a large language model, GPT-4, to create significance statements based on paper abstracts and this more than doubled the average effect size without fine-tuning. Study 2 experimentally demonstrated that simply-written generative pre-trained transformer (GPT) summaries facilitated more favorable perceptions of scientists (they were perceived as more credible and trustworthy, but less intelligent) than more complexly written human PNAS summaries. Crucially, study 3 experimentally demonstrated that participants comprehended scientific writing better after reading simple GPT summaries compared to complex PNAS summaries. In their own words, participants also summarized scientific papers in a more detailed and concrete manner after reading GPT summaries compared to PNAS summaries of the same article. AI has the potential to engage scientific communities and the public via a simple language heuristic, advocating for its integration into scientific dissemination for a more informed society.
引用
收藏
页数:10
相关论文
共 68 条
  • [61] ChatGPT is fun, but not an author
    Thorp, H. Holden
    [J]. SCIENCE, 2023, 379 (6630) : 313 - 313
  • [62] Van Veen Dave, 2023, Res Sq, DOI 10.21203/rs.3.rs-3483777/v1
  • [63] Quality Uncertainty Erodes Trust in Science
    Vazire, Simine
    [J]. COLLABRA-PSYCHOLOGY, 2017, 3 (01):
  • [64] PNAS Plus: Refining a successful experiment
    Verma, Inder M.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (34) : 13469 - 13469
  • [65] Bridging the gap between science and decision making
    von Winterfeldt, Detlof
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2013, 110 : 14055 - 14061
  • [66] Towards health equity for people experiencing chronic pain and social marginalization
    Wallace, Bruce
    Varcoe, Colleen
    Holmes, Cindy
    Moosa-Mitha, Mehmoona
    Moor, Gregg
    Hudspith, Maria
    Craig, Kenneth D.
    [J]. INTERNATIONAL JOURNAL FOR EQUITY IN HEALTH, 2021, 20 (01)
  • [67] A concrete example of construct construction in natural language
    Yeomans, Michael
    [J]. ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 2021, 162 : 81 - 94
  • [68] Generative Artificial Intelligence to Transform Inpatient Discharge Summaries to Patient-Friendly Language and Format
    Zaretsky, Jonah
    Kim, Jeong Min
    Baskharoun, Samuel
    Zhao, Yunan
    Austrian, Jonathan
    Aphinyanaphongs, Yindalon
    Gupta, Ravi
    Blecker, Saul B.
    Feldman, Jonah
    [J]. JAMA NETWORK OPEN, 2024, 7 (03) : E240357