Probabilistic Circuits (PCs) are generative models that support exact inference and, unlike deep neural networks, admit an exact and tractable measure of loss-surface curvature: the trace of the Hessian of the log-likelihood. Recent work regularizes this trace globally to bias learning toward flatter, better generalizi...
Tydra is introduced, a hybrid Transformer-State Space Model (SSM) architecture for tabular in-context learning that interleaves attention and SSM layers that reduces inference time by 30% relative to TabPFN while retaining much of its predictive performance.
Mieszko Komisarczyk, Saurabh Mathur, Maurice Kraus et al.· 1 citation
A unified perspective on the inherent trade-offs between expressivity and tractability is provided, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs, and a taxonomy of the field is provided.
Sahil Sidheekh, S. Natarajan· International Joint Conferen...· 13 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.