This work introduces WhatIf-Bench, a benchmark measuring how well forecasters use covariates to forecast a target's response to future events, and reveals generalization to Novel futures as the core challenge, and offers a testbed toward arbitrary scenario analysis.
Arjun Ashok, Mihir Parmar, Palash Goyal et al.· 0 citations
Tabular foundation models adapt to new datasets through in-context learning (ICL), and, like most transformers, they tie computational depth to the number of independently parameterized layers. We ask whether the ICL stage of such a model needs a distinct set of parameters for every layer, or only depth. We introduce T...
Across Sokoban and autoregressive FineWeb language modeling, this work finds that temporal recurrence shifts the best observed compute allocation toward substantially fewer layers, with comparable or better performance.
Ivan Anokhin, Johan S. Obando-Ceron, Irina Rish et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.