Jun Shu

Harnessing the Potential of Optimizing Data Mixtures via Bayesian Domain Reweighting

Experimental results demonstrate that proposed Bayesian domain weighting method could achieve stable and efficient domain weights learning, and identifies optimal mixtures while consuming substantially less data than search-based function-fitting methods, revitalizing optimization-based domain weighting for large-scale applications.