Skip to content
Log in
Sponsored Artificial Intelligence: A Modern Approach, Global Edition Artificial Intelligence: A Modern Approach, Global Edition

Author

Han-Jin Lee

h-index 1 View on Semantic Scholar

We have 1 of 10 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Streamlined Knowledge Distillation

Streamlined Knowledge Distillation is proposed, a simple yet effective logit-based method that transfers only two essential forms of knowledge without requiring additional alignment or relational modeling and introduces a Mahalanobis distance-based direction-wise loss stabilized through Tikhonov regularization and Cholesky decomposition.

Hyeon-Jin Jeong, Han-Jin Lee, Seok-HwanChoi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.