Principled Transformers for Predictive Performance in Knowledge Tracing
This paper proposes a straightforward model class, knowledge tracing set transformers (KTSTs), specifically addressing predictive performance in knowledge tracing tasks, and introduces learnable ALiBi and MHSA aggregation, which simplifies and improves upon a prevalent attention mechanism in knowledge tracing.