Large Language Models (LLMs) have achieved remarkable capabilities but remain vulnerable to jailbreak attacks that elicit harmful or unsafe outputs. Existing safety alignment approaches, including Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF), often require substantial attack-specif...
Jin-Hao Pang, Jitai Hao, Qiang Huang et al.· 0 citations
Experiments show that Reflective On-policy Self-Distillation (ROSD), which distills transferable reasoning insights rather than complete reference trajectories, consistently outperforms standard OPSD and reinforcement learning baselines, better preserves reasoning diversity, stabilizes training, and mitigates late-stag...
Zi-Qi Zhao, Xin-Yu Ma, Liu Yang et al.· 16 citations
Low-Rank Clone (LRC), an efficient pre-training method that constructs SLMs aspiring to behavioral equivalence with strong teacher models, and maximizes knowledge transfer while removing the need for explicit alignment modules.
Jitai Hao, Qiang Huang, Hao Liu et al.· Neural Information Processin...· 17 citations· ⚡2
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.