Bayesian knowledge tracing

Bayesian knowledge tracing is an algorithm used in many intelligent tutoring systems to model each learner's mastery of the knowledge being tutored.

It models student knowledge in a hidden Markov model as a latent variable, updated by observing the correctness of each student's interaction in which they apply the skill in question. ^[1]

BKT assumes that student knowledge is represented as a set of binary variables, one per skill, where the skill is either mastered by the student or not. Observations in BKT are also binary: a student gets a problem/step either right or wrong. Intelligent tutoring systems often use BKT for mastery learning and problem sequencing. In its most common implementation, BKT has only skill-specific parameters. ^[2]

Method

There are four model parameters used in BKT:

• ${\displaystyle p(L_{0})}$ or ${\displaystyle p{\text{-init}}}$, the probability of the student knowing the skill beforehand.
• ${\displaystyle p(T)}$ or ${\displaystyle p{\text{-transit}}}$, the probability of the student demonstrating knowledge of the skill after an opportunity to apply it
• ${\displaystyle p(S)}$ or ${\displaystyle p{\text{-slip}}}$, the probability the student makes a mistake when applying a known skill
• ${\displaystyle p(G)}$ or ${\displaystyle p{\text{-guess}}}$, the probability that the student correctly applies an unknown skill (has a lucky guess)

Assuming that these parameters are set for all skills, the following formulas are used as follows: The initial probability of a student ${\displaystyle u}$ mastering skill ${\displaystyle k}$ is set to the p-init parameter for that skill equation (a). Depending on whether the student ${\displaystyle u}$ learned and applies skill ${\displaystyle k}$ correctly or incorrectly, the conditional probability is computed by using equation (b) for correct application, or by using equation (c) for incorrect application. The conditional probability is used to update the probability of skill mastery calculated by equation (d). To figure out the probability of the student correctly applying the skill on a future practice is calculated with equation (e).

Equation (a):

${\displaystyle p(L_{1})_{u}^{k}=p(L_{0})^{k}}$

Equation (b):

${\displaystyle p(L_{t}\mid {\text{obs}}={\text{correct}})_{u}^{k}={\frac {p(L_{t})_{u}^{k}\cdot (1-p(S)^{k})}{p(L_{t})_{u}^{k}\cdot (1-p(S)^{k})+(1-p(L_{t})_{u}^{k})\cdot p(G)^{k}}}}$

Equation (c):

${\displaystyle p(L_{t}\mid {\text{obs}}={\text{wrong}})_{u}^{k}={\frac {p(L_{t})_{u}^{k}\cdot p(S)^{k}}{p(L_{t})_{u}^{k}\cdot p(S)^{k}+(1-p(L_{t})_{u}^{k})\cdot (1-p(G)^{k})}}}$

Equation (d):

${\displaystyle p(L_{t+1})_{u}^{k}=p(L_{t}\mid {\text{obs}})_{u}^{k}+(1-p(L_{t}\mid {\text{obs}})_{u}^{k})\cdot p(T)^{k}}$

Equation (e):

${\displaystyle p(C_{t+1})_{u}^{k}=p(L_{t+1})_{u}^{k}\cdot (1-p(S)^{k})+(1-p(L_{t+1})_{u}^{k})\cdot p(G)^{k}}$

^[2]

See also

• Computerized adaptive testing
• Item response theory
• Knowledge space theory
• Latent growth modeling

References

1. Corbett, A. T.; Anderson, J. R. (1995). "Knowledge tracing: Modeling the acquisition of procedural knowledge". User Modeling and User-Adapted Interaction. 4 (4): 253–278. doi:10.1007/BF01099821. S2CID   19228797.
2. Yudelson, M.V.; Koedinger, K.R.; Gordon, G.J. (2013). "Individualized bayesian knowledge tracing models". Artificial Intelligence in Education. Lecture Notes in Computer Science. Vol. 7926. pp. 171–180. doi:10.1007/978-3-642-39112-5_18. ISBN   978-3-642-39111-8. S2CID   15120295.

Further reading

• Ines, ŠG.; Ani, G.; Angelina, G. (2024). "Twenty-Five Years of Bayesian knowledge tracing: a systematic review". User Modeling and User-Adapted Interaction. doi:10.1007/s11257-023-09389-4.