From complexity to clarity: How AI enhances perceptions of scientists and the public's understanding of science

被引:1
作者
Markowitz, David M. [1 ]
机构
[1] Michigan State Univ, Dept Commun, E Lansing, MI 48824 USA
来源
PNAS NEXUS | 2024年 / 3卷 / 09期
关键词
science communication; generative AI; large language models; credibility; comprehension; LANGUAGE; WORDS; FLUENCY;
D O I
10.1093/pnasnexus/pgae387
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This article evaluated the effectiveness of using generative AI to simplify science communication and enhance the public's understanding of science. By comparing lay summaries of journal articles from PNAS, yoked to those generated by AI, this work first assessed linguistic simplicity differences across such summaries and public perceptions in follow-up experiments. Specifically, study 1a analyzed simplicity features of PNAS abstracts (scientific summaries) and significance statements (lay summaries), observing that lay summaries were indeed linguistically simpler, but effect size differences were small. Study 1b used a large language model, GPT-4, to create significance statements based on paper abstracts and this more than doubled the average effect size without fine-tuning. Study 2 experimentally demonstrated that simply-written generative pre-trained transformer (GPT) summaries facilitated more favorable perceptions of scientists (they were perceived as more credible and trustworthy, but less intelligent) than more complexly written human PNAS summaries. Crucially, study 3 experimentally demonstrated that participants comprehended scientific writing better after reading simple GPT summaries compared to complex PNAS summaries. In their own words, participants also summarized scientific papers in a more detailed and concrete manner after reading GPT summaries compared to PNAS summaries of the same article. AI has the potential to engage scientific communities and the public via a simple language heuristic, advocating for its integration into scientific dissemination for a more informed society.
引用
收藏
页数:10
相关论文
共 68 条
  • [51] Language left behind on social media exposes the emotional and cognitive costs of a romantic breakup
    Seraj, Sarah
    Blackburn, Kate G.
    Pennebaker, James W.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (07)
  • [52] Reading dies in complexity: Online news consumers prefer simple writing
    Shulman, Hillary C.
    Markowitz, David M.
    Rogers, Todd
    [J]. SCIENCE ADVANCES, 2024, 10 (23):
  • [53] Advancing Framing Theory: Designing an Equivalency Frame to Improve Political Information Processing
    Shulman, Hillary C.
    Sweitzer, Matthew D.
    [J]. HUMAN COMMUNICATION RESEARCH, 2018, 44 (02) : 155 - 175
  • [54] Operating on Anxiety: Negative Affect toward Breast Cancer and Choosing Contralateral Prophylactic Mastectomy
    Silverstein, Michael C.
    Lee, Clara N.
    Scherer, Laura D.
    Phommasathit, Crystal
    Merrill, Andrea L.
    Peters, Ellen
    [J]. MEDICAL DECISION MAKING, 2023, 43 (02) : 152 - 163
  • [55] If It's Hard to Read, It's Hard to Do: Processing Fluency Affects Effort Prediction and Motivation
    Song, Hyunjin
    Schwarz, Norbert
    [J]. PSYCHOLOGICAL SCIENCE, 2008, 19 (10) : 986 - 988
  • [56] Trusting on the shoulders of open giants? Open science increases trust in science for the public and academics
    Song, Hyunjin
    Markowitz, David M.
    Taylor, Samuel Hardman
    [J]. JOURNAL OF COMMUNICATION, 2022, 72 (04) : 497 - 510
  • [57] Scientific abstracts and plain language summaries in psychology: A comparison based on readability indices
    Stricker, Johannes
    Chasiotis, Anita
    Kerwer, Martin
    Guenther, Armin
    [J]. PLOS ONE, 2020, 15 (04):
  • [58] The Effects of Metacognition in Survey Research: Experimental, Cross-Sectional, and Content-Analytic Evidence
    Sweitzer, Matthew D.
    Shulman, Hillary C.
    [J]. PUBLIC OPINION QUARTERLY, 2018, 82 (04) : 745 - 768
  • [59] The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
    Tausczik, Yla R.
    Pennebaker, James W.
    [J]. JOURNAL OF LANGUAGE AND SOCIAL PSYCHOLOGY, 2010, 29 (01) : 24 - 54
  • [60] Editor's note
    Thorp, H. Holden
    Vinson, Valda
    [J]. SCIENCE, 2023, 379 (6636) : 991 - 991