#natural language process...
Mar 2026
Domain Mixture Design via Log-Likelihood Differences for Aligning Language Models with a Target Model
A method for determining domain weights by viewing models as points in log-likelihood space and aligning the training update direction with the direction toward the target model is proposed.
Ryōji Kishino, Riku Shiomi, Hiroaki Yamagiwa et al.
· arXiv.org · 0 citations