Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning
Experiments show that knowledge-aligned SFT can reduce factual hallucinations on WildHalu and Biography while largely preserving general capabilities and confirm that SFT targets beyond the base model's knowledge drive hallucination behavior.
AR Becker, Jakob Kemmler, David Thulke et al.
· 0 citations