Generalization Can Emerge in Tabular Foundation Models From a Single Table
This work systematically pre-training and evaluating on many diverse datasets and analyzes what aspects of the data are most important for building a Tabular Foundation Model (TFM) generalizing across domains to show that the number and quality of tasks one can construct from a dataset is key to downstream performance.