ⓘ Bayesian Knowledge Tracing


ⓘ Bayesian Knowledge Tracing

Bayesian Knowledge Tracing is an algorithm used in many intelligent tutoring systems to model each learners mastery of the knowledge being tutored.

It models student knowledge in a Hidden Markov Model as a latent variable, updated by observing the correctness of each students interaction in which they apply the skill in question.

BKT assumes that student knowledge is represented as a set of binary variables, one per skill, where the skill is either mastered by the student or not. Observations in BKT are also binary: a student gets a problem/step either right or wrong. Intelligent tutoring systems often use BKT for mastery learning and problem sequencing. In its most common implementation, BKT has only skill-specific parameters.


1. Method

There are 4 model parameters used in BKT:

  • p G {\displaystyle pG} or p {\displaystyle p} - g u e s {\displaystyle guess}, the probability that the student correctly applies an unknown skill has a lucky guess
  • p T {\displaystyle pT} or p {\displaystyle p} - t r a n s i t {\displaystyle transit}, the probability of the student demonstrating knowledge of the skill after an opportunity to apply it
  • p S {\displaystyle pS} or p {\displaystyle p} - s l i p {\displaystyle slip}, the probability the student makes a mistake when applying a known skill
  • p L 0 {\displaystyle pL_{0}} or p {\displaystyle p} - i n i t {\displaystyle init}, the probability of the student knowing the skill beforehand.

Assuming that these parameters are set for all skills, the following formulas are used as follows: The initial probability of a student u {\displaystyle u} mastering skill k {\displaystyle k} is set to the p-init parameter for that skill equation a. Depending on whether the student u {\displaystyle u} learned and applies skill k {\displaystyle k} correctly or incorrectly, the conditional probability is computed by using equation b for correct application, or by using equation c for incorrect application. The conditional probability is used to update the probability of skill mastery calculated by equation d. To figure out the probability of the student correctly applying the skill on a future practice is calculated with equation e.

Equation a:

p L 1 u k = p L 0 k {\displaystyle pL_{1}_{u}^{k}=pL_{0}^{k}}

Equation b:

p L t | o b s = c o r e c t u k = p L t u k ⋅ 1 − p S k) p L t u k ⋅ 1 − p S k) + 1 − p L t u k) ⋅ p G k {\displaystyle pL_{t}|obs=correct_{u}^{k}={\frac {pL_{t}_{u}^{k}\cdot 1-pS^{k})}{pL_{t}_{u}^{k}\cdot 1-pS^{k})+1-pL_{t}_{u}^{k})\cdot pG^{k}}}}

Equation c:

p L t | o b s = w r o n g u k = p L t u k ⋅ p S k p L t u k ⋅ p S k + 1 − p L t u k) ⋅ 1 − p G k) {\displaystyle pL_{t}|obs=wrong_{u}^{k}={\frac {pL_{t}_{u}^{k}\cdot pS^{k}}{pL_{t}_{u}^{k}\cdot pS^{k}+1-pL_{t}_{u}^{k})\cdot 1-pG^{k})}}}

Equation d:

p L t + 1 u k = p L t | o b s u k + 1 − p L t | o b s u k) ⋅ p T k {\displaystyle pL_{t+1}_{u}^{k}=pL_{t}|obs_{u}^{k}+1-pL_{t}|obs_{u}^{k})\cdot pT^{k}}

Equation e:

p C t + 1 u k = p L t + 1 u k ⋅ 1 − p S k) + 1 − p L t + 1 u k) ⋅ p G k {\displaystyle pC_{t+1}_{u}^{k}=pL_{t+1}_{u}^{k}\cdot 1-pS^{k})+1-pL_{t+1}_{u}^{k})\cdot pG^{k}}