GRADE: Probing Knowledge Gaps in LLMs through Gradient Subspace Dynamics
GRADE (GRAdient Dynamics for knowlEdge gap detection), which quantifies the knowledge gap via the cross-layer rank ratio of the gradient to that of the corresponding hidden state subspace, motivated by the property of gradients as estimators of the required knowledge updates for a given target.