On the Transfer of Output Diversity via Synthetic Data in Language Models
This paper finds that output-distribution tendencies can be partially transmitted through unrelated synthetic data, and suggests that diversity-related behavior is shaped, at least in part, by the latent model state rather than solely by decoding-time randomness.
Adisesh Venkatesh Sanklapur
· 0 citations