AI-assisted analysis of content, structure, and sentiment in MOOC discussion forums
被引:3
作者:
Yee, Michael
论文数: 0引用数: 0
h-index: 0
机构:
MIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Yee, Michael
[1
]
Roy, Anindya
论文数: 0引用数: 0
h-index: 0
机构:
MIT, Open Learning, Cambridge, MA USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Roy, Anindya
[2
]
Perdue, Meghan
论文数: 0引用数: 0
h-index: 0
机构:
MIT, Open Learning, Cambridge, MA USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Perdue, Meghan
[2
]
Cuevas, Consuelo
论文数: 0引用数: 0
h-index: 0
机构:
MIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Cuevas, Consuelo
[1
]
Quigley, Keegan
论文数: 0引用数: 0
h-index: 0
机构:
MIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Quigley, Keegan
[1
]
Bell, Ana
论文数: 0引用数: 0
h-index: 0
机构:
MIT, Dept Elect Engn & Comp Sci, Cambridge, MA USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Bell, Ana
[3
]
Rungta, Ahaan
论文数: 0引用数: 0
h-index: 0
机构:
MIT, Open Learning, Cambridge, MA USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Rungta, Ahaan
[2
]
Miyagawa, Shigeru
论文数: 0引用数: 0
h-index: 0
机构:
MIT, Dept Linguist & Philosophy, Cambridge, MA USAMIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
Miyagawa, Shigeru
[4
]
机构:
[1] MIT Lincoln Lab, Artificial Intelligence Technol Grp, Lexington, MA 02421 USA
[2] MIT, Open Learning, Cambridge, MA USA
[3] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA USA
[4] MIT, Dept Linguist & Philosophy, Cambridge, MA USA
MOOCs;
discussion forums;
forum posts;
natural language processing;
text classification;
machine learning;
transformers;
artificial intelligence;
D O I:
10.3389/feduc.2023.1250846
中图分类号:
G40 [教育学];
学科分类号:
040101 ;
120403 ;
摘要:
Discussion forums are a key component of online learning platforms, allowing learners to ask for help, provide help to others, and connect with others in the learning community. Analyzing patterns of forum usage and their association with course outcomes can provide valuable insight into how learners actually use discussion forums, and suggest strategies for shaping forum dynamics to improve learner experiences and outcomes. However, the fine-grained coding of forum posts required for this kind of analysis is a manually intensive process that can be challenging for large datasets, e.g., those that result from popular MOOCs. To address this issue, we propose an AI-assisted labeling process that uses advanced natural language processing techniques to train machine learning models capable of labeling a large dataset while minimizing human annotation effort. We fine-tune pretrained transformer-based deep learning models on category, structure, and emotion classification tasks. The transformer-based models outperform a more traditional baseline that uses support vector machines and a bag-of-words input representation. The transformer-based models also perform better when we augment the input features for an individual post with additional context from the post's thread (e.g., the thread title). We validate model quality through a combination of internal performance metrics, human auditing, and common-sense checks. For our Python MOOC dataset, we find that annotating approximately 1% of the forum posts achieves performance levels that are reliable for downstream analysis. Using labels from the validated AI models, we investigate the association of learner and course attributes with thread resolution and various forms of forum participation. We find significant differences in how learners of different age groups, gender, and course outcome status ask for help, provide help, and make posts with emotional (positive or negative) sentiment.
机构:
Hong Kong Polytech Univ, Sch Optometry, Kowloon, Hong Kong, Peoples R China
Hong Kong Polytech Univ, Res Ctr SHARP Vis RCSV, Kowloon, Hong Kong, Peoples R ChinaZhejiang Univ, Affliated Hosp 2, Eye Ctr, Zhejiang Prov Engn Inst Eye Dis,Sch Med,Zhejiang P, Hangzhou, Zhejiang, Peoples R China
Shi, Danli
Grzybowski, Andrzej
论文数: 0引用数: 0
h-index: 0
机构:
Fdn Ophthalmol Dev, Inst Res Ophthalmol, Poznan, PolandZhejiang Univ, Affliated Hosp 2, Eye Ctr, Zhejiang Prov Engn Inst Eye Dis,Sch Med,Zhejiang P, Hangzhou, Zhejiang, Peoples R China
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Shao, Lei
Yan, Xinzong
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Basic Lab, Med Coll, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Yan, Xinzong
Liu, Chengjiang
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Med Univ, Dept Gastroenterol, He Fei, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Liu, Chengjiang
Guo, Can
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Guo, Can
Cai, Baojia
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Marchi, Filippo
Bellini, Elisa
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Bellini, Elisa
Iandelli, Andrea
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Iandelli, Andrea
Sampieri, Claudio
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa, Dept Expt Med DIMES, Genoa, Italy
Hosp Clin Univ, Dept Otolaryngol, Barcelona, Spain
Hosp Clin Barcelona, Funct Unit Head Neck Tumors, Barcelona, SpainIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Sampieri, Claudio
Peretti, Giorgio
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China
Wang, Ben
Deng, Yiwen
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China
Deng, Yiwen
Jiang, Haiyue
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China
机构:
Hong Kong Polytech Univ, Sch Optometry, Kowloon, Hong Kong, Peoples R China
Hong Kong Polytech Univ, Res Ctr SHARP Vis RCSV, Kowloon, Hong Kong, Peoples R ChinaZhejiang Univ, Affliated Hosp 2, Eye Ctr, Zhejiang Prov Engn Inst Eye Dis,Sch Med,Zhejiang P, Hangzhou, Zhejiang, Peoples R China
Shi, Danli
Grzybowski, Andrzej
论文数: 0引用数: 0
h-index: 0
机构:
Fdn Ophthalmol Dev, Inst Res Ophthalmol, Poznan, PolandZhejiang Univ, Affliated Hosp 2, Eye Ctr, Zhejiang Prov Engn Inst Eye Dis,Sch Med,Zhejiang P, Hangzhou, Zhejiang, Peoples R China
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Shao, Lei
Yan, Xinzong
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Basic Lab, Med Coll, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Yan, Xinzong
Liu, Chengjiang
论文数: 0引用数: 0
h-index: 0
机构:
Anhui Med Univ, Dept Gastroenterol, He Fei, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Liu, Chengjiang
Guo, Can
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
Guo, Can
Cai, Baojia
论文数: 0引用数: 0
h-index: 0
机构:
Qinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R ChinaQinghai Univ, Dept Gastrointestinal Oncol, Affiliated Hosp, Xining, Qinghai, Peoples R China
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Marchi, Filippo
Bellini, Elisa
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Bellini, Elisa
Iandelli, Andrea
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Iandelli, Andrea
Sampieri, Claudio
论文数: 0引用数: 0
h-index: 0
机构:
Univ Genoa, Dept Expt Med DIMES, Genoa, Italy
Hosp Clin Univ, Dept Otolaryngol, Barcelona, Spain
Hosp Clin Barcelona, Funct Unit Head Neck Tumors, Barcelona, SpainIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Sampieri, Claudio
Peretti, Giorgio
论文数: 0引用数: 0
h-index: 0
机构:
IRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
Univ Genoa, Dept Surg Sci & Integrated Diagnost DISC, I-16132 Genoa, ItalyIRCCS Osped Policlin San Martino, Unit Otorhinolaryngol Head & Neck Surg, Largo Rosanna Benzi 10, I-16132 Genoa, Italy
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China
Wang, Ben
Deng, Yiwen
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China
Deng, Yiwen
Jiang, Haiyue
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R ChinaChinese Acad Med Sci & Peking Union Med Coll, Plast Surg Hosp, Beijing, Peoples R China