LECDPR:LLM Enhancement and Concept-Document Interactive Modeling for Prerequisite Relation Prediction
TL;DR
LECDPR elicits an LLM via two-stage prompting to distill concept descriptions and contextual evidence from documents, resulting in semantic space embeddings, and the complex interactive relations between concepts and documents are modeled to produce relational space embeddings.
Abstract
Accurate prediction of prerequisite relations among concepts is important for course planning and intelligent tutoring systems. Existing text-based methods are frequently contaminated by noise such as redundant phrasing, ambiguous sentences, and domain-specific colloquialisms. Moreover, previous methods based on graph structures may have failed to capture the complex interactions between concepts and documents, an information gap exists between the two approaches. Therefore, we propose an LLM Enhancement and Concept-Document Interactive Modeling for Prerequisite Relation Prediction (LECDPR) model. Concretely, LECDPR elicits an LLM via two-stage prompting to distill concept descriptions and contextual evidence from documents, resulting in semantic space embeddings of concepts. Then, the complex interactive relations between concepts and documents are modeled through three propagation mechanisms to produce relational space embeddings, aligns the two embeddings through random masking and contrastive learning, and adaptively fuses the resulting embeddings. Finally, the fused concept representations are used for more accurate prerequisite relation prediction. Extensive experiments on the public UCD, Lecture Bank, and MOOC datasets show that LECDPR outperforms ten baselines on ACC, AUC, and F1. Our code is available at https://github.com/lecdpr/LECDPR.