TY - JOUR
T1 - ChatPRCS: A Personalized Support System for English Reading Comprehension based on ChatGPT
AU - Wang, X.
AU - Zhong, Y.
AU - Huang, C.
AU - Huang, X.
PY - 2024/5/27
Y1 - 2024/5/27
N2 - Reading comprehension is a widely adopted method for learning English, involving reading articles and answering related questions. However, the reading comprehension training typically focuses on the skill level required for a standardized learning stage, without considering the impact of individual differences in linguistic competence. This paper presents a personalized support system for reading comprehension, named ChatPRCS, based on the Zone of Proximal Development (ZPD) theory. It leverages the advanced capabilities of large language models (LLMs), exemplified by ChatGPT (Chat Generative Pre-trained Transformer). ChatPRCS employs methods including skill prediction, question generation, and automatic evaluation, to enhance reading comprehension instruction. Firstly, a ZPD-based algorithm is developed to predict students' reading comprehension skills. This algorithm analyzes historical data to generate questions with appropriate difficulty. Second, a series of ChatGPT prompt patterns is proposed to address two key aspects of reading comprehension objectives: question generation, and automated evaluation. These patterns further improve the quality of generated questions. Finally, by integrating personalized skill prediction and reading comprehension prompt patterns, ChatPRCS is validated through a series of experiments. Empirical results demonstrate that it provides learners with high-quality reading comprehension questions that are broadly aligned with expert-crafted questions at a statistical level. Furthermore, this study investigates the effect of the system on learning achievement, learning motivation and cognitive load, providing further evidence of its effectiveness in instructing English reading comprehension.
AB - Reading comprehension is a widely adopted method for learning English, involving reading articles and answering related questions. However, the reading comprehension training typically focuses on the skill level required for a standardized learning stage, without considering the impact of individual differences in linguistic competence. This paper presents a personalized support system for reading comprehension, named ChatPRCS, based on the Zone of Proximal Development (ZPD) theory. It leverages the advanced capabilities of large language models (LLMs), exemplified by ChatGPT (Chat Generative Pre-trained Transformer). ChatPRCS employs methods including skill prediction, question generation, and automatic evaluation, to enhance reading comprehension instruction. Firstly, a ZPD-based algorithm is developed to predict students' reading comprehension skills. This algorithm analyzes historical data to generate questions with appropriate difficulty. Second, a series of ChatGPT prompt patterns is proposed to address two key aspects of reading comprehension objectives: question generation, and automated evaluation. These patterns further improve the quality of generated questions. Finally, by integrating personalized skill prediction and reading comprehension prompt patterns, ChatPRCS is validated through a series of experiments. Empirical results demonstrate that it provides learners with high-quality reading comprehension questions that are broadly aligned with expert-crafted questions at a statistical level. Furthermore, this study investigates the effect of the system on learning achievement, learning motivation and cognitive load, providing further evidence of its effectiveness in instructing English reading comprehension.
UR - http://www.scopus.com/inward/record.url?scp=85194854752&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85194854752&partnerID=8YFLogxK
U2 - 10.1109/TLT.2024.3405747
DO - 10.1109/TLT.2024.3405747
M3 - Article
SN - 1939-1382
SP - 1762
EP - 1776
JO - IEEE Transactions on Learning Technologies
JF - IEEE Transactions on Learning Technologies
ER -