From Synthetic Priors to Model Behavior: Structural Coverage in Tabular Foundation Models
This work recovers or reconstructs the synthetic data generators of four TFMs and compares their generated tasks with datasets from two widely used tabular benchmarks, finding substantial differences across synthetic pretraining priors.