Skip to content

Author

Yu-Kun Lai

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

GRADE: Probing Knowledge Gaps in LLMs through Gradient Subspace Dynamics

GRADE (GRAdient Dynamics for knowlEdge gap detection), which quantifies the knowledge gap via the cross-layer rank ratio of the gradient to that of the corresponding hidden state subspace, motivated by the property of gradients as estimators of the required knowledge updates for a given target.

Yujing Wang, Yuanbang Liang, Yu-Kun Lai et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.