PMAES: Prompt-mapping Contrastive Learning for Cross-prompt Automated Essay Scoring

被引:0
|
作者
Chen, Yuan [1 ]
Li, Xia [1 ]
机构
[1] Guangdong Univ Foreign Studies, Sch Informat Sci & Technol, Guangzhou, Peoples R China
来源
PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1 | 2023年
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current cross-prompt automated essay scoring (AES) is a challenging task due to the large discrepancies between different prompts, such as different genres and expressions. The main goal of current cross-prompt AES systems is to learn enough shared features between the source and target prompts to grade well on the target prompt. However, because the features are captured based on the original prompt representation, they may be limited by being extracted directly between essays. In fact, when the representations of two prompts are more similar, we can gain more shared features between them. Based on this motivation, in this paper, we propose a learning strategy called "prompt-mapping" to learn about more consistent representations of source and target prompts. In this way, we can obtain more shared features between the two prompts and use them to better represent the essays for the target prompt. Experimental results on the ASAP++ dataset demonstrate the effectiveness of our method. We also design experiments in different settings to show that our method can be applied in different scenarios. Our code is available at https://github.com/gdufsnlp/PMAES.
引用
收藏
页码:1489 / 1503
页数:15
相关论文
共 50 条
  • [1] Automated Cross-prompt Scoring of Essay Traits
    Ridley, Robert
    He, Liang
    Dai, Xin-yu
    Huang, Shujian
    Chen, Jiajun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13745 - 13753
  • [2] EPCTS: Enhanced Prompt-Aware Cross-Prompt Essay Trait Scoring
    Xu, Jiangsong
    Liu, Jian
    Lin, Mingwei
    Lin, Jiayin
    Yu, Shenbao
    Zhao, Liang
    Shen, Jun
    NEUROCOMPUTING, 2025, 621
  • [3] Pairwise dual-level alignment for cross-prompt automated essay scoring
    Zhang, Chunyun
    Deng, Jiqin
    Dong, Xiaolin
    Zhao, Hongyan
    Liu, Kailin
    Cui, Chaoran
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 265
  • [4] Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the Art
    Li, Shengjie
    Ng, Vincent
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 7661 - 7681
  • [5] Prompt- and Trait Relation-aware Cross-prompt Essay Trait Scoring
    Do, Heejin
    Kim, Yunsu
    Lee, Gary Geunbae
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 1538 - 1551
  • [6] Making meta-learning solve cross-prompt automatic essay scoring
    Wang, Jiong
    Zhang, Qing
    Liu, Jie
    Wang, Xiaoyi
    Xu, Mingying
    Yang, Liguang
    Zhou, Jianshe
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 272
  • [7] Enhanced cross-prompt trait scoring via syntactic feature fusion and contrastive learning
    Sun, Jingbo
    Peng, Weiming
    Song, Tianbao
    Liu, Haitao
    Zhu, Shuqin
    Song, Jihua
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (04): : 5390 - 5407
  • [8] Enhanced cross-prompt trait scoring via syntactic feature fusion and contrastive learning
    Jingbo Sun
    Weiming Peng
    Tianbao Song
    Haitao Liu
    Shuqin Zhu
    Jihua Song
    The Journal of Supercomputing, 2024, 80 : 5390 - 5407
  • [9] Sentence-BERT Distinguishes Good and Bad Essays in Cross-prompt Automated Essay Scoring
    Sasaki, Toru
    Masada, Tomonari
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW, 2022, : 274 - 281
  • [10] SEDNN: Shared and enhanced deep neural network model for cross-prompt automated essay scoring
    Li, Xia
    Chen, Minping
    Nie, Jian-Yun
    KNOWLEDGE-BASED SYSTEMS, 2020, 210