Author

F. Wang

h-index 3 View on Semantic Scholar

We have 2 of 7 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Rethinking Reverse KL as Adaptive Entropy Distillation

This work revisits on-policy Reverse Kullback-Leibler distillation and decomposes its objective into a teacher-fitting term and a student-entropy term, without introducing an explicit FKL branch, and proposes Adaptive Entropy Distillation (AED), which uses the teacher's entropy to dynamically calibrate token-level imit...

Shizheng Li, Zhiyu Shen, Yu-Yin Lu et al. · 0 citations

Open access Jul 2026

Causal Adversarial Training for Improving Language Understanding and Robustness

Language models suffer from adversarial vulnerability, where imperceptible perturbations in inputs can mislead model predictions. Existing adversarial training methods enhance model robustness by augmenting training data with worst-case adversarial perturbations for each input. However, these approaches overlook the...

Bin Zhu, Yi Xie, Yanxia Feng et al. · Computational Linguistics · 0 citations