Multivariate time series anomaly detection (MTAD) is crucial for ensuring the safe and reliable operation of complex systems. Many existing methods learn normal patterns by training reconstruction or forecasting models on predominantly normal data. However, a large portion of these approaches rely on deterministic mode...
W. Koo, Jaeyeong Lee, Taeseong Yoon et al.· 0 citations
What determines the unavoidable sample cost of learning cyclic causal structure? For cyclic linear non-Gaussian models, we study exact condensation recovery from observational data: identifying the strongly connected component (SCC) partition and all edges between components. We establish the first information-theoreti...
Non-negative matrix factorization (NMF) is a singular statistical model whose Bayesian asymptotics are governed by the real log canonical threshold (RLCT). We study the local geometry of the factorization map and derive an upper bound for the RLCT of NMF. Let $H$ be the model inner dimension and $H_0$ the non-negative...
Testing whether two populations of networks share the same edge probabilities is a basic problem in network inference. How hard it is depends on the norm used to measure the difference. For the inhomogeneous Erd\H{o}s--R\'enyi (IER) model, the optimal sample complexity is known for every integer $L_r$ norm and for $1\l...
Soham Dan· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Inverse Optimal Transport (OT) based methods for representation learning learn representations such that the global OT coupling between a pair of data marginals in the representation space, concentrates on the positive pairs. This is in contrast to previous methods that primarily focused on pairwise matching. However,...
Ngoc-Hai Nguyen, Thuan Nguyen, Prakash Ishwar et al.· 0 citations
Estimating causal effects with continuous treatments in observational studies is challenging due to confounding, model misspecification, and high-dimensional covariates. We propose the Weighted Spline-Expanded Network (WSENet), an end-to-end neural framework that addresses these challenges by combining covariate balanc...
Shu-Cheng Liu, Chan Park, Guan-Hua Chen· 0 citations
This review presents a unified Bayesian formulation of KD that formulates teacher predictions as prior information and establishes a rigorous connection to uncertainty quantification, providing a principled interpretation of how teacher information is incorporated into student learning.
Lu-Yang Fang, Hao-Ran Lu, Jia-Zhang Cai et al.· 0 citations
This work introduces SPatial coHErent risk control for REplay (SPHERE), a general replay-allocation method applicable across a broad range of learning settings and demonstrates that SPHERE improves accuracy and reduces forgetting across noisy-label vision tasks, continual language-model instruction tuning, and code-gen...
Hai-Xiang Sun, Jie-Fu Zhang, Yi He et al.· 0 citations
It is argued that ARD endures because of its seamless integration with kernel learning, universal software support, and low cost, and it is argued that ARD delivers effective rather than exact sparsity.
It is shown that a studentized multiplier bootstrap of the GP derivative process repairs both its validity through an invariance principle for quadratic forms, and it is shown that asymptotic family-wise and false-discovery-rate control across inputs are obtained.
Transformers have emerged as powerful architectures for learning solution operators of physical systems. Empirically the prediction error has been observed to decrease when the data size and model size increase, suggesting neural scaling behavior. Yet a theoretical understanding of such scaling laws for transformer-bas...
Haoran Yan, Zhongjie Shi, Yuanzhe Xi et al.· 0 citations
Conditional independence (CI) is a fundamental concept in statistics and machine learning. Recent advances in conditional generative modeling provide flexible tools for generative-model-based CI tests, which rely on an estimated conditional distribution to generate randomized samples. However, errors in estimating this...
Yan-Feng Yang, Jun-Da Zhao, Yi-Jie Gao et al.· 0 citations
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.