Large Language Models for Career Readiness Prediction

被引:0
作者
Cui, Chenwei [3 ]
Abdalla, Amro [2 ]
Wijaya, Derry [1 ]
Solberg, Scott [1 ]
Bargal, Sarah Adel [2 ]
机构
[1] Boston Univ, Boston, MA 02215 USA
[2] Georgetown Univ, Washington, DC USA
[3] Arizona State Univ, Tempe, AZ 85287 USA
来源
ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, PT I | 2024年 / 2150卷
关键词
Large Language Models; Career Readiness Prediction; Natural Language Processing; Classification; GPT; REFLEXIVITY; LIFE;
D O I
10.1007/978-3-031-64315-6_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large Language Models (LLMs) have recently achieved state-of-the-art performance on many benchmark Natural Language Processing (NLP) tasks. In this work, we are introducing a novel application, career readiness prediction, in the area of NLP for education. We analyze a dataset of student narratives and explore how reliably different LLMs classify them using Marcia's (1980) identity statuses. We explore the capabilities and limitations of LLMs on this new task and find that there is good potential for automated career readiness evaluation, and for improved survey design that enables larger-scale data collection.
引用
收藏
页码:304 / 311
页数:8
相关论文
共 19 条
[1]  
[Anonymous], 2022, BLOOM 176B PARAMETER, DOI DOI 10.48550/ARXIV.2211.05100
[2]  
Brown TB, 2020, ADV NEUR IN, V33
[3]   Scalable Educational Question Generation with Pre-trained Language Models [J].
Bulathwela, Sahan ;
Muse, Hamze ;
Yilmaz, Emine .
ARTIFICIAL INTELLIGENCE IN EDUCATION, AIED 2023, 2023, 13916 :327-339
[4]  
Chowdhery A, 2023, J MACH LEARN RES, V24
[5]   Improving Automated Evaluation of Student Text Responses Using GPT-3.5 for Text Data Augmentation [J].
Cochran, Keith ;
Cohn, Clayton ;
Rouet, Jean Francois ;
Hastings, Peter .
ARTIFICIAL INTELLIGENCE IN EDUCATION, AIED 2023, 2023, 13916 :217-228
[6]  
Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
[7]   Reducing the Cost: Cross-Prompt Pre-finetuning for Short Answer Scoring [J].
Funayama, Hiroaki ;
Asazuma, Yuya ;
Matsubayashi, Yuichiroh ;
Mizumoto, Tomoya ;
Inui, Kentaro .
ARTIFICIAL INTELLIGENCE IN EDUCATION, AIED 2023, 2023, 13916 :78-89
[8]   Reflexivity in life design interventions: Comments on life and career design dialogues [J].
Guichard, Jean .
JOURNAL OF VOCATIONAL BEHAVIOR, 2016, 97 :78-83
[9]  
Lin Xi Victoria., 2022, P 2022 C EMPIRICAL M, P9019, DOI [10.18653/v1/2022.emnlp-main.616, DOI 10.18653/V1/2022.EMNLP-MAIN.616]
[10]  
Marcia J E., 1980, Handbook of adolescent psychology, P159, DOI DOI 10.1002/9780470479193