TY - JOUR
T1 - Learning consistent representations with temporal and causal enhancement for knowledge tracing
AU - Huang, Changqin
AU - Wei, Hangjie
AU - Huang, Qionghao
AU - Jiang, Fan
AU - Han, Zhongmei
AU - Huang, Xiaodi
PY - 2024/7/1
Y1 - 2024/7/1
N2 - Knowledge tracing is a crucial component of intelligent educational systems and deep learning technologies have significantly propelled its advancement. However, most existing models suffer from the incomplete data modeling problem of knowledge tracing, leading to inconsistent representations of students’ actual knowledge states. This paper proposes a new approach called Temporal- and Causal-enhanced Knowledge Tracing to improve the consistency of students’ knowledge state representations in intelligent educational systems. In particular, our method introduces a causal self-attention mechanism based on front-door adjustment theory, which improves interaction representation and reduces prediction errors caused by dataset bias. To effectively integrate the features of interval and response times into our model, we further use forget and input gates to simulate knowledge forgetting and acquisition, respectively. This maintains consistent learning behavior representations and improves model predictions. The results of our extensive experiments on the three datasets demonstrate that our method outperforms previous knowledge-tracing methods in predicting student scores.
AB - Knowledge tracing is a crucial component of intelligent educational systems and deep learning technologies have significantly propelled its advancement. However, most existing models suffer from the incomplete data modeling problem of knowledge tracing, leading to inconsistent representations of students’ actual knowledge states. This paper proposes a new approach called Temporal- and Causal-enhanced Knowledge Tracing to improve the consistency of students’ knowledge state representations in intelligent educational systems. In particular, our method introduces a causal self-attention mechanism based on front-door adjustment theory, which improves interaction representation and reduces prediction errors caused by dataset bias. To effectively integrate the features of interval and response times into our model, we further use forget and input gates to simulate knowledge forgetting and acquisition, respectively. This maintains consistent learning behavior representations and improves model predictions. The results of our extensive experiments on the three datasets demonstrate that our method outperforms previous knowledge-tracing methods in predicting student scores.
KW - Knowledge tracing
KW - Causal inference
KW - Attention mechanism
KW - Time series
UR - http://www.scopus.com/inward/record.url?scp=85182911399&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85182911399&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2023.123128
DO - 10.1016/j.eswa.2023.123128
M3 - Article
SN - 0957-4174
VL - 245
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 123128
ER -