Pathwise gradients are preferred for continuous random variables because they are unbiased, low variance, and work with a single sample. For discrete variables, however, the pathwise identity cannot generally be exact for every differentiable function. We propose a general framework to construct finite-order exact path...
Adversarial training is one of the most reliable defenses against adversarial attacks, but its high computational cost must generally be paid anew for each task. Robust foundation models offer a promising alternative: adversarially pretrain a model once and then transfer its robustness to downstream tasks through light...
Learning an ensemble of GFlowNets to sample from a discrete target distribution has become a common approach for achieving better state space exploration and convergence than that of a monolithic sampler. However, these methods often add a substantial runtime overhead to the base model, and their conceptual connection...
Tiago da Silva, Amauri H. Souza, Salem Lahlou· 0 citations
Combinatorial Thompson sampling (CTS) draws independent posterior samples for every arm, so its exploration dynamics ignore any relation among arms. We study a minimal change to those dynamics: an LLM is queried once for a partition of the arms, the partition becomes a positive-definite correlation matrix $\Sigma$ thro...
Accurate forecasting of pathological outcomes is a central problem in psychology. To do so, psychologists often collect intensive longitudinal data. However, in such studies, the desire to acquire a large number of variables for the sake of accurate prediction is often counteracted by the need to minimize participant b...
Yunni Qu (Department of Computer Science, University of North Carolina at Chapel Hill), Bing Cai Kok (Department of Psychology and Neuroscience et al.· 0 citations
Motivated by sequence-to-sequence transport in the context time-series domain adaptation, we study the problem of transportation between trajectories of Markov processes. Given a limited number of trajectories from source distribution and the target distribution, we formulate a flow matching based algorithm which learn...
Syamantak Kumar, D. Nagaraj, Saptarshi Roy et al.· 0 citations
Representations of translated sentences are similar in the inner layers of multilingual language models -- an observation connected to the platonic representation hypothesis, yet unexplained theoretically. We provide an explanation based on the assumption that data have a hidden hierarchical structure whose abstract le...
Darshil Doshi, Wenjie Zhou, Corinna Elena Wegner et al.· 0 citations
The Fr\'echet Inception Distance (FID) is widely used to evaluate generative models, but its empirical plug-in estimator suffers from finite-sample bias [BSAG18, CF20]. We study the sample complexity $n$ of estimating FID to error $\epsilon$ between $d$-dimensional Gaussians with bounded mean distance and covariances,...
Ziyun Chen, Jerry Li, Kevin Tian et al.· 0 citations
Modern forecasting models are often updated after deployment so they can respond to changing data. These updates can also make predictions worse, so practical systems need a reliable monitor that can detect harmful changes and trigger protection. A natural design is to monitor the same prediction errors that guide the...
Weijia Han, Lisha Qu, Zhenda Li et al.· 0 citations
In this paper, we study the sample complexities of value and policy learning in finite discounted Markov decision processes (MDPs) under recursive entropic risk preferences with risk parameter \(\beta\neq 0\), assuming access to a generative model of the MDP. We provide a refined analysis of model-based risk-sensitive...
Amirparsa Bahrami, Oliver Mortensen, Mohammad Sadegh Talebi· 0 citations
Quinazolin-4(3H)-one and quinazoline-2,4-dione cores represent key pharmacophores widely encountered in medicinal chemistry and materials science [1,2]. We present the crystal structures of three novel 4-chlorophenyl quinazolinones: 3-(4-chlorophenyl)-1-heptylquinazoline-2,4(1H,3H)-dione (I), 3-(4-chlorophenyl) -1-isob...
A.G. Tojiboev, F.A. Zulpanov, M. Bodensteiner et al.· Zenodo (CERN European Organi...· 0 citations
Quinazolin-4(3H)-one and quinazoline-2,4-dione cores represent key pharmacophores widely encountered in medicinal chemistry and materials science [1,2]. We present the crystal structures of three novel 4-chlorophenyl quinazolinones: 3-(4-chlorophenyl)-1-heptylquinazoline-2,4(1H,3H)-dione (I), 3-(4-chlorophenyl) -1-isob...
A.G. Tojiboev, F.A. Zulpanov, M. Bodensteiner et al.· Zenodo (CERN European Organi...· 0 citations
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.